PanGu-ΣHuawei
|
TabFMGoogle
|
|||||
Related Products
|
||||||
About
Significant advancements in the field of natural language processing, understanding, and generation have been achieved through the expansion of large language models. This study introduces a system which utilizes Ascend 910 AI processors and the MindSpore framework to train a language model with over a trillion parameters, specifically 1.085T, named PanGu-{\Sigma}. This model, which builds upon the foundation laid by PanGu-{\alpha}, takes the traditionally dense Transformer model and transforms it into a sparse one using a concept known as Random Routed Experts (RRE). The model was efficiently trained on a dataset of 329 billion tokens using a technique called Expert Computation and Storage Separation (ECSS), leading to a 6.3-fold increase in training throughput via heterogeneous computing. Experimentation indicates that PanGu-{\Sigma} sets a new standard in zero-shot learning for various downstream Chinese NLP tasks.
|
About
TabFM is a zero-shot foundation model for tabular data, designed to simplify classification and regression workflows that traditionally require manual model training, hyperparameter tuning, and domain-specific feature engineering. Built specifically for tables, TabFM reframes tabular prediction as an in-context learning problem: instead of fitting a new supervised model to each dataset, it takes historical training examples and target testing rows together as one unified prompt, then interprets relationships between columns and rows at inference time. Because tables are two-dimensional and orderless, TabFM uses a hybrid architecture that combines alternating row and column attention, row compression, and a dedicated Transformer for in-context learning over compressed row embeddings. This design lets the model capture complex feature interactions and dependencies while keeping prediction computationally efficient for larger datasets.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
AI developers
|
Audience
Data scientists and analytics teams that need accurate tabular classification and regression without repetitive training, tuning, and feature-engineering work
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and VideosNo images available
|
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
Free
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationHuawei
Founded: 1987
China
huawei.com
|
Company InformationGoogle
Founded: 1998
United States
research.google/blog/introducing-tabfm-a-zero-shot-foundation-model-for-tabular-data/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
||||||
|
|
||||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
PanGu Chat
|
||||||
|
|
|