BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee and Kristina Toutanova submitted BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding on October 11, 2018. The paper introduced BERT, a bidirectional Transformer-based language representation model pretrained from unlabeled text and designed for fine-tuning across downstream natural-language-processing tasks.