Inkling-Small

Inkling-Small

Thinking Machines Lab
+
+

Related Products

  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    985 Ratings
    Visit Website
  • Google AI Studio
    30 Ratings
    Visit Website
  • Google Cloud Speech-to-Text
    366 Ratings
    Visit Website
  • Dialpad Support
    1,588 Ratings
    Visit Website
  • LTX
    182 Ratings
    Visit Website
  • Planview AdaptiveWork
    714 Ratings
    Visit Website
  • QEval
    30 Ratings
    Visit Website
  • Elation Health
    88 Ratings
    Visit Website
  • Creatio
    570 Ratings
    Visit Website

About

GPT-Realtime-2.1 is OpenAI’s reasoning model with tool use for low-latency voice agents and complex speech-to-speech workflows. It updates GPT-Realtime-2 with improved alphanumeric recognition, silence and noise handling, and interruption behavior, helping applications understand spoken code, manage imperfect audio, and respond more naturally when users pause or talk over the agent. Developers can configure reasoning effort to balance deeper thinking against latency and output usage, while strong instruction following helps the model stay aligned with a defined role, tone, and workflow. It accepts and produces both audio and text, can take images as input, and supports function calling so an agent can retrieve information or perform actions during a conversation. The model has a 128,000-token context window, supports up to 32,000 output tokens, and includes reasoning-token support for extended interactions.

About

Inkling-Small is an efficient model that offers performance comparable to Inkling at a quarter of its size. It is a Mixture-of-Experts transformer with 276 billion total parameters and 12 billion active parameters, trained on NVIDIA GB300 NVL72 systems. It supports native reasoning across text, images, and audio, variable thinking effort, and context windows of up to one million tokens. Users adjust reasoning effort from minimal to extra high to balance performance and compute. Improved pre-training data, post-training with on-policy distillation from Inkling, and extended agentic coding reinforcement learning helped Inkling-Small surpass its larger counterpart on reasoning and coding benchmarks. It performs well in coding and tool-use harnesses, exceeds 80% on SWE-bench Verified, and combines strong reasoning with efficient output. Its encoder-free multimodal architecture processes audio as dMel spectrograms and images as 40-by-40-pixel patches alongside text tokens.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Developers, AI agent builders, voice AI teams, contact center platforms, customer support teams, product teams, enterprise automation teams, and conversational AI companies that need realtime speech-to-speech interactions, audio input and output, function calling, tool use, configurable reasoning, image input, long-context voice workflows, transcription, translation, and interactive AI assistants

Audience

Developers, AI agent builders, software engineering teams, research teams, enterprise AI teams, multimodal application developers, coding assistant builders, tool-use workflow teams, and organizations that need efficient reasoning, long-context processing, text-image-audio understanding, adjustable thinking effort, coding performance, and scalable Mixture-of-Experts inference

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

$0.40 per cached input
Free Version
Free Trial

Pricing

$0.30 per million input tokens
$0.30 per million input tokens and $1.20 per million output tokens
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 5.0 / 5
features 4.0 / 5

Pros & Cons from Real Users

Pros

  • Inkling-Small is really interesting from a developer’s point of view because it hits a sweet spot between serious model capability and practical deployability. A 276B-parameter model with only 12B active parameters per token is exactly the kind of architecture that makes sense if you care about cost, speed, and scaling real AI workflows. I also like that it is open weights under Apache 2.0. That makes it way more appealing for developers who want to fine-tune, inspect, customize, or build on top of the model without being completely locked into a closed API. The multimodal support is a big plus too. Being able to work with text, images, and audio inputs gives Inkling-Small a lot of room for developer tools, coding agents, support bots, document workflows, and internal automation.

Cons

  • The main downside is that “small” here is still not tiny. Even with only 12B active parameters, this is still a large open model that will require real infrastructure if you want to host it yourself. I would also want to test it deeply before making it the backbone of a production coding agent. The model card and early coverage look promising, but real developer workflows expose problems that benchmarks do not always catch: messy repos, flaky tests, weird dependencies, tool failures, and long multi-step tasks.

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

OpenAI
Founded: 2015
United States
developers.openai.com/api/docs/models/gpt-realtime-2.1

Company Information

Thinking Machines Lab
Founded: 2025
United States
thinkingmachines.ai/news/inkling-small/

Alternatives

Alternatives

Inkling

Inkling

Thinking Machines Lab

Categories

Categories

Integrations

Model Context Protocol (MCP)
OpenAI
Tinker
gpt-realtime

Integrations

Model Context Protocol (MCP)
OpenAI
Tinker
gpt-realtime
Claim GPT-Realtime-2.1 and update features and information
Claim GPT-Realtime-2.1 and update features and information
Claim Inkling-Small and update features and information
Claim Inkling-Small and update features and information