DBRXDatabricks
|
Qwen3.8-Flash-NextAlibaba
|
|||||
Related Products
|
||||||
About
Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks. Across a range of standard benchmarks, DBRX sets a new state-of-the-art for established open LLMs. Moreover, it provides the open community and enterprises building their own LLMs with capabilities that were previously limited to closed model APIs; according to our measurements, it surpasses GPT-3.5, and it is competitive with Gemini 1.0 Pro. It is an especially capable code model, surpassing specialized models like CodeLLaMA-70B in programming, in addition to its strength as a general-purpose LLM. This state-of-the-art quality comes with marked improvements in training and inference performance. DBRX advances the state-of-the-art in efficiency among open models thanks to its fine-grained mixture-of-experts (MoE) architecture. Inference is up to 2x faster than LLaMA2-70B, and DBRX is about 40% of the size of Grok-1 in terms of both total and active parameter counts.
|
About
Qwen3.8-Flash-Next is an open-weight multimodal Mixture-of-Experts model and an early preview of the architecture planned for Qwen4. It systematically upgrades attention, residual connections, embeddings, and optimization to improve capability, computational efficiency, model capacity, and training stability. Its hybrid architecture combines Gated DeltaNet, which efficiently compresses historical information, with Qwen Sparse Attention, which selects important context at the micro-block level to reduce attention and indexing costs on long sequences. Gated Residual widens the residual stream into four branches and dynamically controls information flow across layers, while N-gram Embedding adds large-scale local-pattern memory with very little extra per-token computation and can be offloaded to host memory. The model uses a 125B-parameter main network plus 51B N-gram embedding parameters, while activating only 6B parameters per token.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Organizations looking for an advanced Large Language Model solution
|
Audience
Developers, researchers, and AI teams seeking to run or study an efficient multimodal open-weight model with long-context reasoning, coding, multilingual, and agentic capabilities
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
$2 per 1M (input)
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationDatabricks
United States
www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
|
Company InformationAlibaba
Founded: 1999
China
qwen.ai/blog
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
Alibaba Cloud
Alibaba Cloud Model Studio
Cherry Studio
Cline
ClinePass
Double
GPT-3.5
Happy Shrimp 1.0
Hermes Agent
Hugging Face
|
Integrations
Alibaba Cloud
Alibaba Cloud Model Studio
Cherry Studio
Cline
ClinePass
Double
GPT-3.5
Happy Shrimp 1.0
Hermes Agent
Hugging Face
|
|||||
|
|
|