Attention Is All You Need
Vaswani and colleagues introduced the Transformer architecture in Attention Is All You Need, proposing a sequence-transduction architecture based on attention mechanisms without recurrence or convolutions.
Historical classification
This verified record belongs to LINEAiGE's artificial-intelligence history layer beginning in 1956.
Why it matters
The Transformer became a central architecture in subsequent language-model and generative-AI development.
People, organizations & technologies
PEOPLE
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
TECHNOLOGIES
Transformer, Attention
Evidence & verification
STATE
verified
CONFIDENCE
high
LAST VERIFIED
2026-10-06T23:00:41+08:00
Title, authors, submission date and architecture description verified against the original arXiv record. The arXiv record for Attention Is All You Need is dated 12 June 2017.
Sources
Trace the chronology
Learn this topic
6.034 Artificial Intelligence
MIT OpenCourseWare
CS50's Introduction to Artificial Intelligence with Python
CS50 OpenCourseWare
CS25: Transformers United
Stanford CS25
Elements of AI: Introduction to AI
Elements of AI
Context media
Transformers, explained: Understand the model behind GPT, BERT, and T5
Google Cloud Tech
Record identity
LINEAiGE IDtransformer-2017