subtopic

Why attention: look at every word at once

Learn the core idea: to understand a word, the model looks at all other words in the sentence and decides which matter most. In 'The animal didn't cross the street because it was too tired', attention links 'it' to 'animal'. All words are processed in parallel, so it is fast on GPUs and handles long-distance links.