In the last tutorial, we met an approach developed for text processing but also used to process images. We will go deep into self-attention, and we will also show how to pass the image to the transformer encoder and also how to display an attention map.

Goals:

• Understand Self-Attention
• Learn how to process images using Transformers