Inkling-Small

Inkling-Small

Thinking Machines Lab
5.0 out of 5 stars
Llama 2

Llama 2

Meta
Inkling-Small Llama 2

Related Products

  • LTX
    4.4 out of 5 stars 182 Ratings
    Visit Website for LTX
  • Gemini platform
    4.3 out of 5 stars 1,178 Ratings
    Visit Website for Gemini platform
  • Buildium
    4.5 out of 5 stars 2,563 Ratings
    Visit Website for Buildium
  • RetailEdge
    4.8 out of 5 stars 201 Ratings
    Visit Website for RetailEdge
  • TIMi
    4.9 out of 5 stars 68 Ratings
    Visit Website for TIMi
  • Acadia
    5.0 out of 5 stars 3 Ratings
    Visit Website for Acadia
  • Fraud.net
    4.7 out of 5 stars 57 Ratings
    Visit Website for Fraud.net
  • rezStream Cloud PMS
    4.7 out of 5 stars 126 Ratings
    Visit Website for rezStream Cloud PMS
  • Arlo Training Management Software
    4.6 out of 5 stars 243 Ratings
    Visit Website for Arlo Training Management Software
  • isoTracker Quality Management
    4.6 out of 5 stars 19 Ratings
    Visit Website for isoTracker Quality Management
Inkling-Small:

About

Inkling-Small is an efficient model that offers performance comparable to Inkling at a quarter of its size. It is a Mixture-of-Experts transformer with 276 billion total parameters and 12 billion active parameters, trained on NVIDIA GB300 NVL72 systems. It supports native reasoning across text, images, and audio, variable thinking effort, and context windows of up to one million tokens. Users adjust reasoning effort from minimal to extra high to balance performance and compute. Improved pre-training data, post-training with on-policy distillation from Inkling, and extended agentic coding reinforcement learning helped Inkling-Small surpass its larger counterpart on reasoning and coding benchmarks. It performs well in coding and tool-use harnesses, exceeds 80% on SWE-bench Verified, and combines strong reasoning with efficient output. Its encoder-free multimodal architecture processes audio as dMel spectrograms and images as 40-by-40-pixel patches alongside text tokens.
Llama 2:

About

The next generation of our open source large language model. This release includes model weights and starting code for pretrained and fine-tuned Llama language models — ranging from 7B to 70B parameters. Llama 2 pretrained models are trained on 2 trillion tokens, and have double the context length than Llama 1. Its fine-tuned models have been trained on over 1 million human annotations. Llama 2 outperforms other open source language models on many external benchmarks, including reasoning, coding, proficiency, and knowledge tests. Llama 2 was pretrained on publicly available online data sources. The fine-tuned model, Llama-2-chat, leverages publicly available instruction datasets and over 1 million human annotations. We have a broad range of supporters around the world who believe in our open approach to today’s AI — companies that have given early feedback and are excited to build with Llama 2.
Inkling-Small:

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported
Llama 2:

Platforms Supported

Windows Supported
Mac Supported
Linux Supported
Cloud Supported
On-Premises Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported
Inkling-Small:

Audience

AI researchers and developers seeking an efficient open-weight multimodal model for reasoning, agentic tasks, and lower-cost deployment
Llama 2:

Audience

Developers interested in a powerful free and open source large language model
Inkling-Small:

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported
Llama 2:

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported
Inkling-Small:

API

Offers API Supported
Llama 2:

API

Offers API Not Supported
Inkling-Small:

Screenshots and Videos

Llama 2:

Screenshots and Videos

Inkling-Small:

Pricing

$0.30 per million input tokens
$0.30 per million input tokens and $1.20 per million output tokens
Free Version Not Supported
Free Trial Not Supported
Llama 2:

Pricing

Free
Free Version Supported
Free Trial Not Supported
Inkling-Small:

Reviews/Ratings

Overall 5.0 / 5
features 4.0 / 5
Llama 2:

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software
Inkling-Small:

Pros & Cons from Real Users

Pros

  • Inkling-Small is really interesting from a developer’s point of view because it hits a sweet spot between serious model capability and practical deployability. A 276B-parameter model with only 12B active parameters per token is exactly the kind of architecture that makes sense if you care about cost, speed, and scaling real AI workflows. I also like that it is open weights under Apache 2.0. That makes it way more appealing for developers who want to fine-tune, inspect, customize, or build on top of the model without being completely locked into a closed API. The multimodal support is a big plus too. Being able to work with text, images, and audio inputs gives Inkling-Small a lot of room for developer tools, coding agents, support bots, document workflows, and internal automation.

Cons

  • The main downside is that “small” here is still not tiny. Even with only 12B active parameters, this is still a large open model that will require real infrastructure if you want to host it yourself. I would also want to test it deeply before making it the backbone of a production coding agent. The model card and early coverage look promising, but real developer workflows expose problems that benchmarks do not always catch: messy repos, flaky tests, weird dependencies, tool failures, and long multi-step tasks.
Inkling-Small:

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported
Llama 2:

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported
Inkling-Small:

Company Information

Thinking Machines Lab
Founded: 2025
United States
thinkingmachines.ai/news/inkling-small/
Llama 2:

Company Information

Meta
Founded: 2004
United States
ai.meta.com/llama/
Inkling-Small:

Alternatives

Muse Spark Open

Muse Spark Open

Meta
5.0 out of 5 stars
Llama 2:

Alternatives

Inkling-Small:
GPT-5.6 Luna

GPT-5.6 Luna

OpenAI
5.0 out of 5 stars
Llama 2:
Aya

Aya

Cohere AI
Inkling-Small:
Inkling

Inkling

Thinking Machines Lab
Llama 2:
ChatGLM

ChatGLM

Z.ai
Inkling-Small:
Inkling 2 Small

Inkling 2 Small

Thinking Machines Lab
Llama 2:
Inkling-Small:
SWE-2 Flash

SWE-2 Flash

Cognition
5.0 out of 5 stars
Llama 2:
Inkling-Small:

Categories

Llama 2:

Categories

Inkling-Small:

Integrations

1min.AI Not Supported
Amazon Bedrock Not Supported
Bolna Not Supported
BrandRank.AI Not Supported
Chatterbox Not Supported
Deep Infra Not Supported
Evertune Not Supported
Fleak Not Supported
InfoBaseAI Not Supported
ModelOp Not Supported
NVIDIA Brev Not Supported
OpenPipe Not Supported
PostgresML Not Supported
Preamble Not Supported
Runpod Not Supported
Solar Mini Not Supported
Unify AI Not Supported
Verta Not Supported
WebLLM Not Supported
ZenGuard AI Not Supported
Llama 2:

Integrations

1min.AI Supported
Amazon Bedrock Supported
Bolna Supported
BrandRank.AI Supported
Chatterbox Supported
Deep Infra Supported
Evertune Supported
Fleak Supported
InfoBaseAI Supported
ModelOp Supported
NVIDIA Brev Supported
OpenPipe Supported
PostgresML Supported
Preamble Supported
Runpod Supported
Solar Mini Supported
Unify AI Supported
Verta Supported
WebLLM Supported
ZenGuard AI Supported
Inkling-Small:
Claim Inkling-Small and update features and information
Claim Inkling-Small and update features and information
Llama 2:
Claim Llama 2 and update features and information
Claim Llama 2 and update features and information