Audience
Developers, researchers, and AI teams seeking to run or study an efficient multimodal open-weight model with long-context reasoning, coding, multilingual, and agentic capabilities
About Qwen3.8-Flash-Next
Qwen3.8-Flash-Next is an open-weight multimodal Mixture-of-Experts model and an early preview of the architecture planned for Qwen4. It systematically upgrades attention, residual connections, embeddings, and optimization to improve capability, computational efficiency, model capacity, and training stability. Its hybrid architecture combines Gated DeltaNet, which efficiently compresses historical information, with Qwen Sparse Attention, which selects important context at the micro-block level to reduce attention and indexing costs on long sequences. Gated Residual widens the residual stream into four branches and dynamically controls information flow across layers, while N-gram Embedding adds large-scale local-pattern memory with very little extra per-token computation and can be offloaded to host memory. The model uses a 125B-parameter main network plus 51B N-gram embedding parameters, while activating only 6B parameters per token.
Pricing
Company Information
Videos and Screen Captures
