Sabiá: Portuguese Large Language Models

Ramon Pires, Hugo Abonizio, Thales Sales Almeida and Rodrigo Nogueira submitted Sabiá: Portuguese Large Language Models to arXiv on April 16, 2023. The paper documents language models produced by further pretraining GPT-J and LLaMA models on Portuguese texts and evaluates them on Portuguese-language datasets.