Search Results for "sparse" - Page 8

DeepSeek-V3.2-Speciale is the high-compute, ultra-reasoning variant of DeepSeek-V3.2, designed specifically to push the boundaries of mathematical, logical, and algorithmic intelligence. It builds on the DeepSeek Sparse Attention (DSA) framework, delivering dramatically improved long-context efficiency while preserving full model quality. Unlike the standard version, Speciale is tuned exclusively for deep reasoning and therefore does not support tool-calling, focusing its full capacity on pure cognitive performance. The model uses a scaled reinforcement learning framework that allows it to surpass GPT-5 in several evaluations and reach reasoning performance comparable to Gemini-3.0-Pro. ...

DeepSeek-V3.2 is a cutting-edge large language model developed by DeepSeek-AI, focused on achieving high reasoning accuracy and computational efficiency for agentic tasks. It introduces DeepSeek Sparse Attention (DSA), a new attention mechanism that dramatically reduces computational overhead while maintaining strong long-context performance. Built with a scalable reinforcement learning framework, it reaches near-GPT-5 levels of reasoning and outperforms comparable models like DeepSeek-V3.1 and Gemini-3.0-Pro in advanced benchmarks. ...

...This project depends heavily on (not included): - OpenCASCADE (2D/3D modelling) - NetGen (2D/3D meshing) - NgSolve (assembling of system marices) - GetFEM++ (assembling of system marices) - OpenBLAS (Optimized Linear Algebra Routines) - SparseSuite (Solving sparse matrices) - MuParser (Expression interpreter)

Inkling is Thinking Machines Lab’s first open-weight flagship multimodal Mixture-of-Experts model, designed for advanced reasoning, coding, and autonomous agent workflows. It contains 975B total parameters with 41B active parameters per token, balancing frontier-level capability with efficient sparse inference. The model natively processes text, images, audio, and video within a unified architecture and supports an exceptionally large 1 million token context window for long-document reasoning, repository-scale coding, and agentic execution. Trained from scratch on approximately 45 trillion multimodal tokens, Inkling introduces controllable reasoning effort, allowing users to trade off latency and reasoning depth depending on the task. ...

...It has 284B total parameters with 13B activated and supports a 1M-token context window, making it suitable for long-document reasoning, complex coding, agentic workflows, and large-scale information processing. The model uses a hybrid attention architecture that combines Compressed Sparse Attention and Heavily Compressed Attention to improve long-context efficiency, while Manifold-Constrained Hyper-Connections strengthen signal stability across layers. It is trained on more than 32T tokens and refined through a post-training pipeline that includes supervised fine-tuning, reinforcement learning, domain-specific expert cultivation, and on-policy distillation. ...

...It contains approximately 225.8B total parameters with 23.4B activated per token, making it substantially larger and more capable than Laguna XS.2 while maintaining efficient inference through sparse activation. Trained from scratch on roughly 30 trillion tokens using Poolside’s in-house “Model Factory” pipeline, the model focuses on complex software development tasks, repository-scale reasoning, tool use, and multi-step agent execution. Laguna M.1 was designed to compete with leading frontier coding models on benchmarks such as SWE-Bench, Terminal-Bench, and other agentic engineering evaluations. ...