BeamReflection
|
PanGu-ΣHuawei
|
|||||
Related Products
|
||||||
About
Beam is Reflection’s first open-weight model, a sparse Mixture-of-Experts model with 501 billion total parameters and 23 billion active parameters, built for coding, reasoning, and agentic workloads. Its capabilities come from large-scale pretraining and reinforcement learning, including training on 23.8 trillion diverse, curated, high-quality tokens from the web, public sources, and proprietary licensed datasets. Beam was trained with a particular focus on coding and agentic performance and is designed to deliver competitive open-weight capabilities with efficient inference compute. It supports complex software engineering, terminal, STEM, web search, tool-use, and general knowledge tasks, with reinforcement learning designed to improve multi-step reasoning, tool use, and adaptation to environment feedback. Users can control the tradeoff between performance and token usage through a reasoning effort parameter.
|
About
Significant advancements in the field of natural language processing, understanding, and generation have been achieved through the expansion of large language models. This study introduces a system which utilizes Ascend 910 AI processors and the MindSpore framework to train a language model with over a trillion parameters, specifically 1.085T, named PanGu-{\Sigma}. This model, which builds upon the foundation laid by PanGu-{\alpha}, takes the traditionally dense Transformer model and transforms it into a sparse one using a concept known as Random Routed Experts (RRE). The model was efficiently trained on a dataset of 329 billion tokens using a technique called Expert Computation and Storage Separation (ECSS), leading to a 6.3-fold increase in training throughput via heterogeneous computing. Experimentation indicates that PanGu-{\Sigma} sets a new standard in zero-shot learning for various downstream Chinese NLP tasks.
|
|||||
Platforms Supported
Windows
Supported
Mac
Supported
Linux
Supported
Cloud
Supported
On-Premises
Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
Developers, AI researchers, and engineering teams requiring a tool to run coding, reasoning, tool-use, and agentic workloads with an efficient open-weight language model
|
Audience
AI developers
|
|||||
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Not Supported
|
|||||
API
Offers API
Not Supported
|
API
Offers API
Not Supported
|
|||||
Screenshots and Videos |
Screenshots and VideosNo images available
|
|||||
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Supported
In Person
Not Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationReflection
United States
reflection.ai/blog/introducing-beam
|
Company InformationHuawei
Founded: 1987
China
huawei.com
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
PanGu Chat
Not Supported
|
||||||
|
|
|