DeepSeek-V2DeepSeek
|
K2 HorizonInstitute of Foundation Models
|
|||||
Related Products
|
||||||
About
DeepSeek-V2 is a state-of-the-art Mixture-of-Experts (MoE) language model introduced by DeepSeek-AI, characterized by its economical training and efficient inference capabilities. With a total of 236 billion parameters, of which only 21 billion are active per token, it supports a context length of up to 128K tokens. DeepSeek-V2 employs innovative architectures like Multi-head Latent Attention (MLA) for efficient inference by compressing the Key-Value (KV) cache and DeepSeekMoE for cost-effective training through sparse computation. This model significantly outperforms its predecessor, DeepSeek 67B, by saving 42.5% in training costs, reducing the KV cache by 93.3%, and enhancing generation throughput by 5.76 times. Pretrained on an 8.1 trillion token corpus, DeepSeek-V2 excels in language understanding, coding, and reasoning tasks, making it a top-tier performer among open-source models.
|
About
K2 Horizon is a connected fleet of six open models spanning 375B-A23B, 36B-A4B, 32B, 7B, 3.7B, and 0.9B, designed to deliver strong performance across reasoning, mathematics, coding, agentic tasks, and general capabilities. The models share core architecture, vocabulary, training methodology, interfaces, evaluation infrastructure, and deployment tooling, making it easier to move between sizes and route workloads dynamically. The 375B-A23B model is the fleet’s most capable option for complex reasoning, software engineering, research, and long-horizon agentic work, while the 32B and 36B-A4B models target powerful local deployment. The 36B-A4B model introduces Mixture-of-Value Attention, combining sparse attention with Mixture-of-Experts layers to activate about 4 billion parameters per token while approaching the performance of the dense 32B model.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
AI researchers, developers, and tech enthusiasts seeking a high-performance, cost-efficient open-source language model for advanced natural language processing, coding, and reasoning tasks
|
Audience
AI researchers, developers, and organizations searching for open models for reasoning, coding, tool use, agentic workflows, and deployments
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
Free
Open source
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationDeepSeek
Founded: 2023
China
deepseek.com
|
Company InformationInstitute of Foundation Models
Founded: 2025
United States
ifm.ai/blog/k2/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
SiliconFlow
|
||||||
|
|
|