Aya Expanse

Aya Expanse

Cohere
PanGu-Σ

PanGu-Σ

Huawei
+
+

Related Products

  • Vertex AI
    961 Ratings
    Visit Website
  • LM-Kit.NET
    25 Ratings
    Visit Website
  • Google AI Studio
    11 Ratings
    Visit Website
  • Google Cloud Run
    341 Ratings
    Visit Website
  • AlsoThere
    1 Rating
    Visit Website
  • ClickLearn
    67 Ratings
    Visit Website
  • Jesta Vision Suite
    25 Ratings
    Visit Website
  • Enterprise Bot
    23 Ratings
    Visit Website
  • Ango Hub
    15 Ratings
    Visit Website
  • ZeroPath
    2 Ratings
    Visit Website

About

Aya Expanse redefines multilingual AI as a research model mastering 101 languages through innovative instruction tuning and cross-lingual transfer techniques. By combining a curated open source dataset with compute-efficient pretraining, it achieves unparalleled performance across low- and high-resource languages while reducing infrastructure costs by up to 30%, setting a new benchmark for scalable, inclusive language modeling.

About

Significant advancements in the field of natural language processing, understanding, and generation have been achieved through the expansion of large language models. This study introduces a system which utilizes Ascend 910 AI processors and the MindSpore framework to train a language model with over a trillion parameters, specifically 1.085T, named PanGu-{\Sigma}. This model, which builds upon the foundation laid by PanGu-{\alpha}, takes the traditionally dense Transformer model and transforms it into a sparse one using a concept known as Random Routed Experts (RRE). The model was efficiently trained on a dataset of 329 billion tokens using a technique called Expert Computation and Storage Separation (ECSS), leading to a 6.3-fold increase in training throughput via heterogeneous computing. Experimentation indicates that PanGu-{\Sigma} sets a new standard in zero-shot learning for various downstream Chinese NLP tasks.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Researchers, developers, and organizations building multilingual AI applications who need a high-performance model that understands and generates text across many language

Audience

AI developers

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

No images available

Pricing

Free
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Cohere
Founded: 2019
Canada
cohere.com/research/aya

Company Information

Huawei
Founded: 1987
China
huawei.com

Alternatives

Tiny Aya

Tiny Aya

Cohere AI

Alternatives

LTM-1

LTM-1

Magic AI
Voxtral TTS

Voxtral TTS

Mistral AI
PanGu-α

PanGu-α

Huawei
Llama 2

Llama 2

Meta
Aya Vision

Aya Vision

Cohere AI
Teuken 7B

Teuken 7B

OpenGPT-X
Florence-2

Florence-2

Microsoft

Categories

Categories

Integrations

PanGu Chat

Integrations

PanGu Chat
Claim Aya Expanse and update features and information
Claim Aya Expanse and update features and information
Claim PanGu-Σ and update features and information
Claim PanGu-Σ and update features and information