Attention-based captioning

For detailed learning, refer: Xu et al., in the paper, https://arxiv.org/pdf/1502.03044.pdf, proposed a method for image captioning using an attention mechanism.

Attention-based captioning has become popular recently as it provides better accuracy:

This method trains an attention model in the sequence of the caption, thereby producing better results:

Here is a diagram of LSTM with attention-generating captions:

Get TensorFlow Deep Learning Projects now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.