Hy4Tencent
|
K2 HorizonInstitute of Foundation Models
|
|||||
Related Products
|
||||||
About
Hy4 preview is a new-generation open source Mixture-of-Experts flagship model built for real-world productivity tasks across software engineering, office work, game development, and scientific research. The model contains 770B total parameters with 49B activated per token and supports a 1M-token context window, giving it the capacity to work through large codebases, extensive document collections, and long multi-step tasks. Its 78-layer architecture combines Gated DeepSeek Sparse Attention with IndexCache for cross-layer sparse index reuse and identity Hyper-Connections to expand information flow between layers. A native Multi-Token Prediction layer is included for speculative decoding. Hy4 preview is designed to understand, plan, debug, and verify long-horizon engineering tasks, with additional gains in front-end visual quality and interaction design.
|
About
K2 Horizon is a connected fleet of six open models spanning 375B-A23B, 36B-A4B, 32B, 7B, 3.7B, and 0.9B, designed to deliver strong performance across reasoning, mathematics, coding, agentic tasks, and general capabilities. The models share core architecture, vocabulary, training methodology, interfaces, evaluation infrastructure, and deployment tooling, making it easier to move between sizes and route workloads dynamically. The 375B-A23B model is the fleet’s most capable option for complex reasoning, software engineering, research, and long-horizon agentic work, while the 32B and 36B-A4B models target powerful local deployment. The 36B-A4B model introduces Mixture-of-Value Attention, combining sparse attention with Mixture-of-Experts layers to activate about 4 billion parameters per token while approaching the performance of the dense 32B model.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Developers, researchers, and technical professionals seeking an AI model for coding, document work, game development, scientific reasoning, and complex productivity tasks
|
Audience
AI researchers, developers, and organizations searching for open models for reasoning, coding, tool use, agentic workflows, and deployments
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
No information available.
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationTencent
Founded: 1998
China
hy.tencent.ai/research/hy4-preview
|
Company InformationInstitute of Foundation Models
Founded: 2025
United States
ifm.ai/blog/k2/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
Tencent Hy
|
||||||
|
|
|