Smaug Flash
304B MoE model optimized for agentic coding and long-running workflows
Smaug Flash is an open-weight agentic coding model from Abacus.AI, fine-tuned from DeepSeek-V4-Flash-0731 to improve autonomous software engineering, tool use, and long-running agent workflows. It uses a 304B-parameter Mixture-of-Experts architecture with 43 layers, 256 routed experts, six selected experts per token, and one shared expert. Its attention system combines Multi-Head Latent Attention with a sparse token indexer, while DSpark multi-token prediction provides speculative decoding for faster generation. Smaug-Flash preserves the base model’s 1,048,576-token context window and low, high, and max reasoning-effort settings. Training specifically targets common agent failures such as looping, stalling, and inefficient task completion, producing substantial improvements across agentic coding benchmarks. ...