2017
Attention Is All You Need
Eight researchers, almost all from Google, present the Transformer, an architecture that looks at all the words in a text at the same time and calculates which ones matter most. It becomes the foundation of large language models. It is the T in GPT.
Source: arXiv
