Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
LSTMs' attention mechanisms on CNNs feature maps does wonders.
- from
- Education
- added
- 2026-10-10
- likes
- 0
similar
-
-
Attention and Augmented Recurrent Neural Networks distill.pub
Interesting for visual animations, it is a nice intro to attention mechanisms as an example.
-
Effective Approaches to Attention-based Neural Machine Translation arxiv.org
Exploring different approaches to attention mechanisms.
-
Attention Is All You Need arxiv.org
(AIAYN) - Introducing multi-head self-attention neural networks with positional encoding to do sentence-level NLP without any RNN nor CNN - this paper is a must-read (also see this explanation and this visualization of the paper).
-
Neural Machine Translation by Jointly Learning to Align and Translate arxiv.org
Attention mechanism for LSTMs! Mostly, figures and formulas and their explanations revealed to be useful to me. I gave a talk on that paper here.
-
Education › Papers > Attention Mechanisms: “LSTMs' attention mechanisms on CNNs feature maps does wonders.”