GPT-NeoX

DeepSeek-V4-Pro is a large-scale Mixture-of-Experts (MoE) language model designed for advanced reasoning, coding, and long-context understanding. It features 1.6 trillion total parameters with 49 billion activated parameters, enabling high performance while maintaining efficiency. The model supports an exceptionally large context window of up to one million tokens, allowing it to process extensive documents and workflows. It uses a hybrid attention architecture to optimize long-context performance and reduce computational cost. DeepSeek-V4-Pro is trained on over 32 trillion tokens, improving its knowledge and reasoning capabilities. It also includes advanced optimization techniques for stability and faster convergence during training. The model supports multiple reasoning modes, allowing users to balance speed and accuracy based on their needs. Overall, it provides a powerful open-source solution for complex AI tasks and large-scale applications.

MiMo-V2.6-Pro is Xiaomi MiMo’s most capable open-source omnimodal AI model, built for coding, general agent workflows, visual tasks, research, and multimodal creation. The model combines strong software engineering capabilities with computer use, 3D spatial reasoning, visual perception, and tool use for complex multi-step work. MiMo-V2.6-Pro can build interactive 3D environments, generate Blender models, create frontend interfaces and presentations, and coordinate agents to refine outputs through visual feedback. It also supports research workflows such as literature review, computational experimentation, materials discovery, and formal mathematical proof development. Xiaomi trained the model with large-scale reinforcement learning across coding, general agents, visual tasks, and cybersecurity environments and has open-sourced the technical report, training environments, and RL code.