PanGu-α Technical Paper Submission

The PanGu-α authors submitted the paper "PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation" on April 26, 2021. The paper documents autoregressive language models with up to 200 billion parameters, developed with MindSpore and trained using 2048 Ascend 910 AI processors on 1.1 TB of Chinese pretraining data.