Understanding Attention Mechanisms – Part 4: Turning Similarity Scores into Attention Weights

In the previous article, we just explored the benefits of using dot product instead of cosine...