OpenCLThe Khronos Group
|
PanGu-ΣHuawei
|
|||||
Related Products
|
||||||
About
OpenCL (Open Computing Language) is an open, royalty-free standard for cross-platform parallel programming of heterogeneous computing systems that lets developers accelerate computing tasks by leveraging diverse processors such as CPUs, GPUs, DSPs, and FPGAs across supercomputers, cloud servers, personal computers, mobile devices, and embedded platforms. It defines a programming framework including a C-based language for writing compute kernels and a runtime API to control devices, manage memory, and execute parallel code, giving portable and efficient access to heterogeneous hardware. OpenCL improves speed and responsiveness for a wide range of applications including creative tools, scientific and medical software, vision processing, and neural network training and inferencing by offloading compute-intensive work to accelerator processors.
|
About
Significant advancements in the field of natural language processing, understanding, and generation have been achieved through the expansion of large language models. This study introduces a system which utilizes Ascend 910 AI processors and the MindSpore framework to train a language model with over a trillion parameters, specifically 1.085T, named PanGu-{\Sigma}. This model, which builds upon the foundation laid by PanGu-{\alpha}, takes the traditionally dense Transformer model and transforms it into a sparse one using a concept known as Random Routed Experts (RRE). The model was efficiently trained on a dataset of 329 billion tokens using a technique called Expert Computation and Storage Separation (ECSS), leading to a 6.3-fold increase in training throughput via heterogeneous computing. Experimentation indicates that PanGu-{\Sigma} sets a new standard in zero-shot learning for various downstream Chinese NLP tasks.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Software developers and engineers building high-performance parallel applications that need portable, cross-platform computing across diverse processors
|
Audience
AI developers
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and VideosNo images available
|
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationThe Khronos Group
Founded: 2000
United States
www.khronos.org
|
Company InformationHuawei
Founded: 1987
China
huawei.com
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
|
|
|