DeepScaleR

DeepScaleR

Agentica Project
Smaug-72B

Smaug-72B

Abacus
+
+

Related Products

  • LeaseAccounting.app
    Visit Website
  • BYDFi
    5,933 Ratings
    Visit Website
  • Runpod
    230 Ratings
    Visit Website
  • IONOS Cloud GPU Servers
    45,340 Ratings
    Visit Website
  • Evertune
    1 Rating
    Visit Website
  • Setplex
    10 Ratings
  • Criminal IP ASM
    21 Ratings
    Visit Website
  • LTX
    182 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    1,161 Ratings
    Visit Website
  • Eurekos
    103 Ratings
    Visit Website

About

DeepScaleR is a 1.5-billion-parameter language model fine-tuned from DeepSeek-R1-Distilled-Qwen-1.5B using distributed reinforcement learning and a novel iterative context-lengthening strategy that gradually increases its context window from 8K to 24K tokens during training. It was trained on ~40,000 carefully curated mathematical problems drawn from competition-level datasets like AIME (1984–2023), AMC (pre-2023), Omni-MATH, and STILL. DeepScaleR achieves 43.1% accuracy on AIME 2024, a roughly 14.3 percentage point boost over the base model, and surpasses the performance of the proprietary O1-Preview model despite its much smaller size. It also posts strong results on a suite of math benchmarks (e.g., MATH-500, AMC 2023, Minerva Math, OlympiadBench), demonstrating that small, efficient models tuned with RL can match or exceed larger baselines on reasoning tasks.

About

Smaug-72B is a powerful open-source large language model (LLM) known for several key features: High Performance: It currently holds the top spot on the Hugging Face Open LLM leaderboard, surpassing models like GPT-3.5 in various benchmarks. This means it excels at tasks like understanding, responding to, and generating human-like text. Open Source: Unlike many other advanced LLMs, Smaug-72B is freely available for anyone to use and modify, fostering collaboration and innovation in the AI community. Focus on Reasoning and Math: It specifically shines in handling reasoning and mathematical tasks, attributing this strength to unique fine-tuning techniques developed by Abacus AI, the creators of Smaug-72B. Based on Qwen-72B: It's technically a fine-tuned version of another powerful LLM called Qwen-72B, released by Alibaba, further improving upon its capabilities. Overall, Smaug-72B represents a significant step forward in open-source AI.

Platforms Supported

Windows Supported
Mac Supported
Linux Supported
Cloud Not Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Researchers, students, and developers interested in an AI model capable of mathematical reasoning and logic tasks without requiring heavy hardware

Audience

AI developers interested in a powerful large language model

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

API

Offers API Not Supported

API

Offers API Not Supported

Screenshots and Videos

Screenshots and Videos

No images available

Pricing

Free
Free Version Supported
Free Trial Not Supported

Pricing

Free
Free Version Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Company Information

Agentica Project
Founded: 2025
United States
agentica-project.com

Company Information

Abacus
Founded: 2019
United States
huggingface.co/abacusai/Smaug-72B-v0.1

Alternatives

DeepCoder

DeepCoder

Agentica Project

Alternatives

Qwen

Qwen

Alibaba
Qwen2

Qwen2

Alibaba
Phi-4-reasoning

Phi-4-reasoning

Microsoft
DeepSeek R1

DeepSeek R1

DeepSeek
Athene-V2

Athene-V2

Nexusflow
Qwen3.6

Qwen3.6

Alibaba

Categories

AI Models Supported

Categories

Integrations

ChatLLM Not Supported

Integrations

ChatLLM Supported
Claim DeepScaleR and update features and information
Claim DeepScaleR and update features and information
Claim Smaug-72B and update features and information
Claim Smaug-72B and update features and information