Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

Patrick Lewis and coauthors submitted 'Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks' on May 22, 2020. The paper introduces RAG models that combine a pre-trained sequence-to-sequence model as parametric memory with a dense vector index of Wikipedia accessed through a neural retriever as non-parametric memory.