Audience

AI developers

About ERNIE 3.0 Titan

Pre-trained language models have achieved state-of-the-art results in various Natural Language Processing (NLP) tasks. GPT-3 has shown that scaling up pre-trained language models can further exploit their enormous potential. A unified framework named ERNIE 3.0 was recently proposed for pre-training large-scale knowledge enhanced models and trained a model with 10 billion parameters. ERNIE 3.0 outperformed the state-of-the-art models on various NLP tasks. In order to explore the performance of scaling up ERNIE 3.0, we train a hundred-billion-parameter model called ERNIE 3.0 Titan with up to 260 billion parameters on the PaddlePaddle platform. Furthermore, We design a self-supervised adversarial loss and a controllable language modeling loss to make ERNIE 3.0 Titan generate credible and controllable texts.

Integrations

Ratings/Reviews

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Company Information

Baidu
Founded: 2000
China
research.baidu.com/Public/uploads/61c4362c79ee8.pdf

Videos and Screen Captures

ERNIE 3.0 Titan Screenshot 1
Other Useful Business Software
Ship Agents Faster Icon
Ship Agents Faster

Transform your applications and workflows into powerful agentic systems at global scale.

Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
Get Started Free

Product Details

Platforms Supported
Cloud
Windows
Mac
Linux
On-Premises
Training
Documentation

ERNIE 3.0 Titan Frequently Asked Questions

Q: What kinds of users and organization types does ERNIE 3.0 Titan work with?
Q: What languages does ERNIE 3.0 Titan support in their product?
Q: What type of training does ERNIE 3.0 Titan provide?

ERNIE 3.0 Titan Product Features