subtopic

Transformer block, encoder and decoder

Learn the building block: attention → add & normalise → feed-forward → add & normalise, stacked many times. The encoder reads the whole input (sees all words). The decoder writes output one token at a time and can only look at earlier tokens (masked attention).

Builds on: 1.4 Making networks generalise, 2.4 CNN concepts and first model