DBRXDatabricks
|
Hy4Tencent
|
|||||
Related Products
|
||||||
About
Today, we are excited to introduce DBRX, an open, general-purpose LLM created by Databricks. Across a range of standard benchmarks, DBRX sets a new state-of-the-art for established open LLMs. Moreover, it provides the open community and enterprises building their own LLMs with capabilities that were previously limited to closed model APIs; according to our measurements, it surpasses GPT-3.5, and it is competitive with Gemini 1.0 Pro. It is an especially capable code model, surpassing specialized models like CodeLLaMA-70B in programming, in addition to its strength as a general-purpose LLM. This state-of-the-art quality comes with marked improvements in training and inference performance. DBRX advances the state-of-the-art in efficiency among open models thanks to its fine-grained mixture-of-experts (MoE) architecture. Inference is up to 2x faster than LLaMA2-70B, and DBRX is about 40% of the size of Grok-1 in terms of both total and active parameter counts.
|
About
Hy4 preview is a new-generation open source Mixture-of-Experts flagship model built for real-world productivity tasks across software engineering, office work, game development, and scientific research. The model contains 770B total parameters with 49B activated per token and supports a 1M-token context window, giving it the capacity to work through large codebases, extensive document collections, and long multi-step tasks. Its 78-layer architecture combines Gated DeepSeek Sparse Attention with IndexCache for cross-layer sparse index reuse and identity Hyper-Connections to expand information flow between layers. A native Multi-Token Prediction layer is included for speculative decoding. Hy4 preview is designed to understand, plan, debug, and verify long-horizon engineering tasks, with additional gains in front-end visual quality and interaction design.
|
|||||
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
Platforms Supported
Windows
Not Supported
Mac
Not Supported
Linux
Not Supported
Cloud
Supported
On-Premises
Not Supported
iPhone
Not Supported
iPad
Not Supported
Android
Not Supported
Chromebook
Not Supported
|
|||||
Audience
Organizations looking for an advanced Large Language Model solution
|
Audience
Developers, researchers, and technical professionals seeking an AI model for coding, document work, game development, scientific reasoning, and complex productivity tasks
|
|||||
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
Support
Phone Support
Not Supported
24/7 Live Support
Not Supported
Online
Supported
|
|||||
API
Offers API
Not Supported
|
API
Offers API
Supported
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
Pricing
No information available.
Free Version
Not Supported
Free Trial
Not Supported
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
Training
Documentation
Supported
Webinars
Not Supported
Live Online
Not Supported
In Person
Not Supported
|
|||||
Company InformationDatabricks
United States
www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
|
Company InformationTencent
Founded: 1998
China
hy.tencent.ai/research/hy4-preview
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
Cogent DataHub
Supported
Double
Supported
GPT-3.5
Supported
GPT-4
Supported
Rayven
Supported
Tencent Hy
Not Supported
Visplore
Supported
ZenML
Supported
|
Integrations
Cogent DataHub
Not Supported
Double
Not Supported
GPT-3.5
Not Supported
GPT-4
Not Supported
Rayven
Not Supported
Tencent Hy
Supported
Visplore
Not Supported
ZenML
Not Supported
|
|||||
|
|
|