ERNIE 3.0 Titan

PanGu-α is developed under the MindSpore and trained on a cluster of 2048 Ascend 910 AI processors. The training parallelism strategy is implemented based on MindSpore Auto-parallel, which composes five parallelism dimensions to scale the training task to 2048 processors efficiently, including data parallelism, op-level model parallelism, pipeline model parallelism, optimizer model parallelism and rematerialization. To enhance the generalization ability of PanGu-α, we collect 1.1TB high-quality Chinese data from a wide range of domains to pretrain the model. We empirically test the generation ability of PanGu-α in various scenarios including text summarization, question answering, dialogue generation, etc. Moreover, we investigate the effect of model scales on the few-shot performances across a broad range of Chinese NLP tasks. The experimental results demonstrate the superior capabilities of PanGu-α in performing various tasks under few-shot or zero-shot settings.

ERNIE 5.1 is Baidu’s latest large language model designed to deliver advanced reasoning, agentic AI capabilities, creative writing, and world knowledge performance while operating with significantly improved efficiency. The model builds on the foundation of ERNIE 5.0 while reducing total parameters and training costs, allowing it to achieve flagship-level intelligence at a fraction of the computational expense of comparable models. ERNIE 5.1 performs strongly across international benchmarks for reasoning, search, knowledge, and agentic tasks, ranking among the top global AI models and leading among Chinese-developed models on multiple leaderboards. The platform introduces a new fully asynchronous reinforcement learning infrastructure that improves training efficiency, scalability, and stability for complex long-horizon AI tasks. ERNIE 5.1 also features advanced creative writing capabilities.