Hy4Tencent
|
Qwen3.8-Flash-NextAlibaba
|
|||||
Related Products
|
||||||
About
Hy4 preview is a new-generation open source Mixture-of-Experts flagship model built for real-world productivity tasks across software engineering, office work, game development, and scientific research. The model contains 770B total parameters with 49B activated per token and supports a 1M-token context window, giving it the capacity to work through large codebases, extensive document collections, and long multi-step tasks. Its 78-layer architecture combines Gated DeepSeek Sparse Attention with IndexCache for cross-layer sparse index reuse and identity Hyper-Connections to expand information flow between layers. A native Multi-Token Prediction layer is included for speculative decoding. Hy4 preview is designed to understand, plan, debug, and verify long-horizon engineering tasks, with additional gains in front-end visual quality and interaction design.
|
About
Qwen3.8-Flash-Next is an open-weight multimodal Mixture-of-Experts model and an early preview of the architecture planned for Qwen4. It systematically upgrades attention, residual connections, embeddings, and optimization to improve capability, computational efficiency, model capacity, and training stability. Its hybrid architecture combines Gated DeltaNet, which efficiently compresses historical information, with Qwen Sparse Attention, which selects important context at the micro-block level to reduce attention and indexing costs on long sequences. Gated Residual widens the residual stream into four branches and dynamically controls information flow across layers, while N-gram Embedding adds large-scale local-pattern memory with very little extra per-token computation and can be offloaded to host memory. The model uses a 125B-parameter main network plus 51B N-gram embedding parameters, while activating only 6B parameters per token.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Developers, researchers, and technical professionals seeking an AI model for coding, document work, game development, scientific reasoning, and complex productivity tasks
|
Audience
Developers, researchers, and AI teams seeking to run or study an efficient multimodal open-weight model with long-context reasoning, coding, multilingual, and agentic capabilities
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
No information available.
Free Version
Free Trial
|
Pricing
$2 per 1M (input)
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationTencent
Founded: 1998
China
hy.tencent.ai/research/hy4-preview
|
Company InformationAlibaba
Founded: 1999
China
qwen.ai/blog
|
|||||
Alternatives |
Alternatives |
|||||
|
|
|
|||||
|
|
|
|||||
|
|
||||||
|
|
||||||
Categories |
Categories |
|||||
Integrations
Alibaba Cloud
Alibaba Cloud Model Studio
Cherry Studio
Cline
ClinePass
Happy Shrimp 1.0
Hermes Agent
Hugging Face
Model Context Protocol (MCP)
ModelScope
|
Integrations
Alibaba Cloud
Alibaba Cloud Model Studio
Cherry Studio
Cline
ClinePass
Happy Shrimp 1.0
Hermes Agent
Hugging Face
Model Context Protocol (MCP)
ModelScope
|
|||||
|
|
|