Attention Is All You Need
Attention Is All You Need is a 2017 paper by Google researchers that introduced the transformer architecture.
1 article
Last mentioned Attention Is All You Need is a machine translation paper published by Google researchers in 2017. It proposed the transformer, an architecture that processes text with attention mechanisms alone, without recurrent neural networks.
The transformer became the basis of most generative AI models, including large language models, and the paper is counted among the most cited papers in AI.
This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.