Language Models are Few-Shot Learners (GPT-3)

Tom B. Brown and coauthors submitted Language Models are Few-Shot Learners on May 28, 2020. The paper reports GPT-3, an autoregressive language model with 175 billion parameters, and evaluates task-agnostic zero-shot, one-shot and few-shot performance without gradient updates or fine-tuning during those evaluations.