Paper · Vaswani et al., “Attention Is All You Need”
We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely.
Each part, with its gloss
What this sentence leaves
We propose a new simple network architecture · based solely on attention mechanisms · dispensing with recurrence and convolutions entirelyWe propose a new simple network architecture called the Transformer, based solely on attention mechanisms and dispensing with recurrence and convolutions entirelyMemory chainbased → solely on attention mechanisms · dispensing → with recurrence and convolutions entirely
