Dot Product in Machine Learning: The Engine Behind Similarity, Attention, and Neural Networks

TLDR: The dot product multiplies corresponding elements of two vectors and sums the results. In machine learning it does three critical jobs: it scores semantic similarity between embeddings, computes every activation in a fully connected layer, and ...