Attention Is All You Need

Vaswani and colleagues introduced the Transformer architecture in Attention Is All You Need, proposing a sequence-transduction architecture based on attention mechanisms without recurrence or convolutions.