Compare the Top Small Language Models for Cloud as of August 2026 - Page 2

  • 1
    Grok 3 mini

    Grok 3 mini

    SpaceXAI

    Grok-3 Mini, crafted by xAI, is an agile and insightful AI companion tailored for users who need quick, yet thorough answers to their questions. This smaller version maintains the essence of the Grok series, offering an external, often humorous perspective on human affairs with a focus on efficiency. Designed for those on the move or with limited resources, Grok-3 Mini delivers the same level of curiosity and helpfulness in a more compact form. It's adept at handling a broad spectrum of questions, providing succinct insights without compromising on depth or accuracy, making it a perfect tool for fast-paced, modern-day inquiries.
    Starting Price: Free
  • 2
    Solar Mini

    Solar Mini

    Upstage AI

    Solar Mini is a pre‑trained large language model that delivers GPT‑3.5‑comparable responses with 2.5× faster inference while staying under 30 billion parameters. It achieved first place on the Hugging Face Open LLM Leaderboard in December 2023 by combining a 32‑layer Llama 2 architecture, initialized with high‑quality Mistral 7B weights, with an innovative “depth up‑scaling” (DUS) approach that deepens the model efficiently without adding complex modules. After DUS, continued pretraining restores and enhances performance, and instruction tuning in a QA format, especially for Korean, refines its ability to follow user prompts, while alignment tuning ensures its outputs meet human or advanced AI preferences. Solar Mini outperforms competitors such as Llama 2, Mistral 7B, Ko‑Alpaca, and KULLM across a variety of benchmarks, proving that compact size need not sacrifice capability.
    Starting Price: $0.1 per 1M tokens
  • 3
    Syn

    Syn

    Upstage AI

    Syn is a next‑generation Japanese large language model co‑developed by Upstage and Karakuri, featuring under 14 billion parameters and optimized for enterprise use in finance, manufacturing, legal, and healthcare. It delivers top‑tier benchmark performance on the Weights & Biases Nejumi Leaderboard, achieving industry‑leading scores for accuracy and alignment, while maintaining cost efficiency through a lightweight architecture derived from Solar Mini. Syn excels in Japanese “truthfulness” and safety, understanding nuanced expressions and industry‑specific terminology, and offers flexible fine‑tuning to integrate proprietary data and domain knowledge. Built for scalable deployment, it supports on‑premises, AWS Marketplace, and cloud environments, with security and compliance safeguards tailored to enterprise requirements. Leveraging AWS Trainium, Syn reduces training costs by approximately 50 percent compared to traditional GPU setups, enabling rapid customization of use cases.
    Starting Price: $0.1 per 1M tokens
  • 4
    LFM2

    LFM2

    Liquid AI

    LFM2 is a next-generation series of on-device foundation models built to deliver the fastest generative-AI experience across a wide range of endpoints. It employs a new hybrid architecture that achieves up to 2x faster decode and prefill performance than comparable models, and up to 3x improvements in training efficiency compared to the previous generation. These models strike an optimal balance of quality, latency, and memory for deployment on embedded systems, allowing real-time, on-device AI across smartphones, laptops, vehicles, wearables, and other endpoints, enabling millisecond inference, device resilience, and full data sovereignty. Available in three dense checkpoints (0.35 B, 0.7 B, and 1.2 B parameters), LFM2 demonstrates benchmark performance that outperforms similarly sized models in tasks such as knowledge recall, mathematics, multilingual instruction-following, and conversational dialogue evaluations.
  • 5
    Seed2.0 Lite

    Seed2.0 Lite

    ByteDance

    Seed2.0 Lite is part of ByteDance’s Seed2.0 family of general-purpose multimodal AI agent models designed to handle complex, real-world tasks with a balanced focus on performance and efficiency. It offers enhanced multimodal understanding and instruction-following capabilities compared with earlier Seed models, enabling it to process and reason about text, visual elements, and structured information reliably for production-grade applications. As a mid-sized model in the series, Lite is optimized to deliver good quality outputs with responsive performance at lower cost and faster inference than the Pro variant while surpassing the previous generation’s capabilities, making it suitable for workflows that require stable reasoning, long-context understanding, and multimodal task execution without needing the highest possible raw performance.
  • 6
    Seed2.0 Mini

    Seed2.0 Mini

    ByteDance

    Seed2.0 Mini is the smallest member of ByteDance’s Seed2.0 series of general-purpose multimodal agent models, designed for high-throughput inference and dense deployment while retaining the core strengths of its larger siblings in multimodal understanding and instruction following. Part of a family that also includes Pro and Lite, the Mini variant is optimized for high-concurrency and batch generation workloads, making it suitable for applications where efficient processing of many requests at scale matters as much as capability. Like other Seed2.0 models, it benefits from systematic enhancements in visual reasoning, motion perception, structured extraction from complex inputs like text and images, and reliable execution of multi-step instructions, but it trades some raw reasoning and output quality for faster, more cost-effective inference and better deployment efficiency.
  • 7
    Phi-2

    Phi-2

    Microsoft

    We are now releasing Phi-2, a 2.7 billion-parameter language model that demonstrates outstanding reasoning and language understanding capabilities, showcasing state-of-the-art performance among base language models with less than 13 billion parameters. On complex benchmarks Phi-2 matches or outperforms models up to 25x larger, thanks to new innovations in model scaling and training data curation. With its compact size, Phi-2 is an ideal playground for researchers, including for exploration around mechanistic interpretability, safety improvements, or fine-tuning experimentation on a variety of tasks. We have made Phi-2 available in the Azure AI Studio model catalog to foster research and development on language models.
  • 8
    Phi-3

    Phi-3

    Microsoft

    A family of powerful, small language models (SLMs) with groundbreaking performance at low cost and low latency. Maximize AI capabilities, lower resource use, and ensure cost-effective generative AI deployments across your applications. Accelerate response times in real-time interactions, autonomous systems, apps requiring low latency, and other critical scenarios. Run Phi-3 in the cloud, at the edge, or on device, resulting in greater deployment and operation flexibility. Phi-3 models were developed in accordance with Microsoft AI principles: accountability, transparency, fairness, reliability and safety, privacy and security, and inclusiveness. Operate effectively in offline environments where data privacy is paramount or connectivity is limited. Generate more coherent, accurate, and contextually relevant outputs with an expanded context window. Deploy at the edge to deliver faster responses.
  • 9
    Jamba

    Jamba

    AI21 Labs

    Jamba is the most powerful & efficient long context model, open for builders and built for the enterprise. Jamba's latency outperforms all leading models of comparable sizes. Jamba's 256k context window is the longest openly available. Jamba's Mamba-Transformer MoE architecture is designed for cost & efficiency gains. Jamba offers key features of OOTB including function calls, JSON mode output, document objects, and citation mode. Jamba 1.5 models maintain high performance across the full length of their context window. Jamba 1.5 models achieve top scores across common quality benchmarks. Secure deployment that suits your enterprise. Seamlessly start using Jamba on our production-grade SaaS platform. The Jamba model family is available for deployment across our strategic partners. We offer VPC & on-prem deployments for enterprises that require custom solutions. For enterprises that have unique, bespoke requirements, we offer hands-on management, continuous pre-training, etc.
  • 10
    LFM-3B

    LFM-3B

    Liquid AI

    LFM-3B delivers incredible performance for its size. It positions itself as first place among 3B parameter transformers, hybrids, and RNN models, but also outperforms the previous generation of 7B and 13B models. It is also on par with Phi-3.5-mini on multiple benchmarks, while being 18.4% smaller. LFM-3B is the ideal choice for mobile and other edge text-based applications.
  • 11
    Amazon Nova
    Amazon Nova is a new generation of state-of-the-art (SOTA) foundation models (FMs) that deliver frontier intelligence and industry leading price-performance, available exclusively on Amazon Bedrock. Amazon Nova Micro, Amazon Nova Lite, and Amazon Nova Pro are understanding models that accept text, image, or video inputs and generate text output. They provide a broad selection of capability, accuracy, speed, and cost operation points. Amazon Nova Micro is a text only model that delivers the lowest latency responses at very low cost. Amazon Nova Lite is a very low-cost multimodal model that is lightning fast for processing image, video, and text inputs. Amazon Nova Pro is a highly capable multimodal model with the best combination of accuracy, speed, and cost for a wide range of tasks. Amazon Nova Pro’s capabilities, coupled with its industry-leading speed and cost efficiency, makes it a compelling model for almost any task, including video summarization, Q&A, math & more.
  • 12
    Phi-4

    Phi-4

    Microsoft

    Phi-4 is a 14B parameter state-of-the-art small language model (SLM) that excels at complex reasoning in areas such as math, in addition to conventional language processing. Phi-4 is the latest member of our Phi family of small language models and demonstrates what’s possible as we continue to probe the boundaries of SLMs. Phi-4 is currently available on Azure AI Foundry under a Microsoft Research License Agreement (MSRLA) and will be available on Hugging Face. Phi-4 outperforms comparable and larger models on math related reasoning due to advancements throughout the processes, including the use of high-quality synthetic datasets, curation of high-quality organic data, and post-training innovations. Phi-4 continues to push the frontier of size vs quality.
  • 13
    Qwen2.5-VL-32B
    Qwen2.5-VL-32B is a state-of-the-art AI model designed for multimodal tasks, offering advanced capabilities in both text and image reasoning. It builds upon the earlier Qwen2.5-VL series, improving response quality with more human-like, formatted answers. The model excels in mathematical reasoning, fine-grained image understanding, and complex, multi-step reasoning tasks, such as those found in MathVista and MMMU benchmarks. Its superior performance has been demonstrated in comparison to other models, outperforming the larger Qwen2-VL-72B in certain areas. With improved image parsing and visual logic deduction, Qwen2.5-VL-32B provides a detailed, accurate analysis of images and can generate responses based on complex visual inputs. It has been optimized for both text and image tasks, making it ideal for applications requiring sophisticated reasoning and understanding across different media.
  • 14
    Amazon Nova Micro
    Amazon Nova Micro is an AI model designed for high-speed, low-cost text processing and generation. It excels in language understanding, translation, code completion, and mathematical problem-solving, providing fast responses with a generation speed of over 200 tokens per second. The model supports fine-tuning for text input and is ideal for applications requiring real-time processing and efficiency. With support for 200+ languages and a maximum of 128k tokens, Nova Micro is perfect for interactive AI applications that prioritize speed and affordability.
  • 15
    Amazon Nova Lite
    Amazon Nova Lite is a cost-efficient, multimodal AI model designed for rapid processing of image, video, and text inputs. It delivers impressive performance at an affordable price, making it ideal for interactive, high-volume applications where cost is a key consideration. With support for fine-tuning across text, image, and video inputs, Nova Lite excels in a variety of tasks that require fast, accurate responses, such as content generation and real-time analytics.
  • 16
    Phi-4-reasoning
    Phi-4-reasoning is a 14-billion parameter transformer-based language model optimized for complex reasoning tasks, including math, coding, algorithmic problem solving, and planning. Trained via supervised fine-tuning of Phi-4 on carefully curated "teachable" prompts and reasoning demonstrations generated using o3-mini, it generates detailed reasoning chains that effectively leverage inference-time compute. Phi-4-reasoning incorporates outcome-based reinforcement learning to produce longer reasoning traces. It outperforms significantly larger open-weight models such as DeepSeek-R1-Distill-Llama-70B and approaches the performance levels of the full DeepSeek-R1 model across a wide range of reasoning tasks. Phi-4-reasoning is designed for environments with constrained computing or latency. Fine-tuned with synthetic data generated by DeepSeek-R1, it provides high-quality, step-by-step problem solving.
  • 17
    Phi-4-reasoning-plus
    Phi-4-reasoning-plus is a 14-billion parameter open-weight reasoning model that builds upon Phi-4-reasoning capabilities. It is further trained with reinforcement learning to utilize more inference-time compute, using 1.5x more tokens than Phi-4-reasoning, to deliver higher accuracy. Despite its significantly smaller size, Phi-4-reasoning-plus achieves better performance than OpenAI o1-mini and DeepSeek-R1 at most benchmarks, including mathematical reasoning and Ph.D. level science questions. It surpasses the full DeepSeek-R1 model (with 671 billion parameters) on the AIME 2025 test, the 2025 qualifier for the USA Math Olympiad. Phi-4-reasoning-plus is available on Azure AI Foundry and HuggingFace.
  • 18
    Phi-4-mini-reasoning
    Phi-4-mini-reasoning is a 3.8-billion parameter transformer-based language model optimized for mathematical reasoning and step-by-step problem solving in environments with constrained computing or latency. Fine-tuned with synthetic data generated by the DeepSeek-R1 model, it balances efficiency with advanced reasoning ability. Trained on over one million diverse math problems spanning multiple levels of difficulty from middle school to Ph.D. level, Phi-4-mini-reasoning outperforms its base model on long sentence generation across various evaluations and surpasses larger models like OpenThinker-7B, Llama-3.2-3B-instruct, and DeepSeek-R1. It features a 128K-token context window and supports function calling, enabling integration with external tools and APIs. Phi-4-mini-reasoning can be quantized using Microsoft Olive or Apple MLX Framework for deployment on edge devices such as IoT, laptops, and mobile devices.
  • 19
    Xgen-small

    Xgen-small

    Salesforce

    Xgen-small is an enterprise-ready compact language model developed by Salesforce AI Research, designed to deliver long-context performance at a predictable, low cost. It combines domain-focused data curation, scalable pre-training, length extension, instruction fine-tuning, and reinforcement learning to meet the complex, high-volume inference demands of modern enterprises. Unlike traditional large models, Xgen-small offers efficient processing of extensive contexts, enabling the synthesis of information from internal documentation, code repositories, research reports, and real-time data streams. With sizes optimized at 4B and 9B parameters, it provides a strategic advantage by balancing cost efficiency, privacy safeguards, and long-context understanding, making it a sustainable and predictable solution for deploying Enterprise AI at scale.
  • 20
    OpenAI o4-mini-high
    OpenAI o4-mini-high is an enhanced version of the o4-mini, optimized for higher reasoning capacity and performance. It maintains the same compact size but significantly boosts its ability to handle more complex tasks with improved efficiency. Whether you're dealing with large datasets, advanced mathematical computations, or intricate coding problems, o4-mini-high provides faster, more accurate responses, making it perfect for high-demand applications.
  • 21
    Phi-4-mini-flash-reasoning
    Phi-4-mini-flash-reasoning is a 3.8 billion‑parameter open model in Microsoft’s Phi family, purpose‑built for edge, mobile, and other resource‑constrained environments where compute, memory, and latency are tightly limited. It introduces the SambaY decoder‑hybrid‑decoder architecture with Gated Memory Units (GMUs) interleaved alongside Mamba state‑space and sliding‑window attention layers, delivering up to 10× higher throughput and a 2–3× reduction in latency compared to its predecessor without sacrificing advanced math and logic reasoning performance. Supporting a 64 K‑token context length and fine‑tuned on high‑quality synthetic data, it excels at long‑context retrieval, reasoning tasks, and real‑time inference, all deployable on a single GPU. Phi-4-mini-flash-reasoning is available today via Azure AI Foundry, NVIDIA API Catalog, and Hugging Face, enabling developers to build fast, scalable, logic‑intensive applications.
  • 22
    Nemotron 3 Nano
    Nemotron 3 Nano is the smallest model in the NVIDIA Nemotron 3 family, built for agentic AI applications with strong reasoning, conversational ability, and cost-efficient inference. It is a hybrid Mamba-Transformer Mixture-of-Experts model with 3.2 billion active parameters, 3.6 billion including embeddings, and 31.6 billion total parameters. NVIDIA describes it as more accurate than the previous Nemotron 2 Nano while activating less than half of the parameters per forward pass, improving efficiency without sacrificing performance. The model is positioned as more accurate than GPT-OSS-20B and Qwen3-30B-A3B-Thinking-2507 on popular benchmarks across different categories. On an 8K input and 16K output setting using a single H200, it delivers inference throughput 3.3 times higher than Qwen3-30B-A3B and 2.2 times higher than GPT-OSS-20B. Nemotron 3 Nano supports context lengths up to 1 million tokens and is reported to outperform GPT-OSS-20B and Qwen3-30B-A3B-Instruct-2507.
  • 23
    SubQ 1.1 Small

    SubQ 1.1 Small

    Subquadratic

    SubQ 1.1 Small is a long-context AI model from Subquadratic designed to reason over complete enterprise artifacts such as codebases, document collections, contracts, and financial filings. It uses Subquadratic Sparse Attention, or SSA, to reduce the high compute costs normally associated with processing very large context windows. The model delivers near-perfect long-context retrieval across 1M, 2M, 6M, and 12M token tests while using far less attention compute than dense attention. SubQ 1.1 Small also maintains strong general reasoning, coding, knowledge, and agentic task performance across multiple benchmarks. Its capabilities make it useful for financial analysis, legal review, contract work, software engineering, due diligence, and other workflows where information is spread across large artifacts. SubQ is built for organizations that want to move beyond fragmented retrieval pipelines and enable direct reasoning over massive bodies of information.
  • 24
    CodeGemma
    CodeGemma is a collection of powerful, lightweight models that can perform a variety of coding tasks like fill-in-the-middle code completion, code generation, natural language understanding, mathematical reasoning, and instruction following. CodeGemma has 3 model variants, a 7B pre-trained variant that specializes in code completion and generation from code prefixes and/or suffixes, a 7B instruction-tuned variant for natural language-to-code chat and instruction following; and a state-of-the-art 2B pre-trained variant that provides up to 2x faster code completion. Complete lines, and functions, and even generate entire blocks of code, whether you're working locally or using Google Cloud resources. Trained on 500 billion tokens of primarily English language data from web documents, mathematics, and code, CodeGemma models generate code that's not only more syntactically correct but also semantically meaningful, reducing errors and debugging time.
  • 25
    OpenAI o3-mini
    OpenAI o3-mini is a lightweight version of the advanced o3 AI model, offering powerful reasoning capabilities in a more efficient and accessible package. Designed to break down complex instructions into smaller, manageable steps, o3-mini excels in coding tasks, competitive programming, and problem-solving in mathematics and science. This compact model provides the same high-level precision and logic as its larger counterpart but with reduced computational requirements, making it ideal for use in resource-constrained environments. With built-in deliberative alignment, o3-mini ensures safe, ethical, and context-aware decision-making, making it a versatile tool for developers, researchers, and businesses seeking a balance between performance and efficiency.
  • 26
    OpenAI o4-mini
    The o4-mini model is a compact and efficient version of the o3 model, released following the launch of GPT-4.1. It offers enhanced reasoning capabilities, with improved performance in tasks that require complex reasoning and problem-solving. The o4-mini is designed to meet the growing demand for advanced AI solutions, serving as a more efficient alternative while maintaining the capabilities of its predecessor. This model is part of OpenAI's strategy to refine and advance their AI technologies ahead of the anticipated GPT-5 launch.
  • 27
    Llama

    Llama

    Meta

    Llama (Large Language Model Meta AI) is a state-of-the-art foundational large language model designed to help researchers advance their work in this subfield of AI. Smaller, more performant models such as Llama enable others in the research community who don’t have access to large amounts of infrastructure to study these models, further democratizing access in this important, fast-changing field. Training smaller foundation models like Llama is desirable in the large language model space because it requires far less computing power and resources to test new approaches, validate others’ work, and explore new use cases. Foundation models train on a large set of unlabeled data, which makes them ideal for fine-tuning for a variety of tasks. We are making Llama available at several sizes (7B, 13B, 33B, and 65B parameters) and also sharing a Llama model card that details how we built the model in keeping with our approach to Responsible AI practices.
  • 28
    OpenELM

    OpenELM

    Apple

    OpenELM is an open-source language model family developed by Apple. It uses a layer-wise scaling strategy to efficiently allocate parameters within each layer of the transformer model, leading to enhanced accuracy compared to existing open language models of similar size. OpenELM is trained on publicly available datasets and achieves state-of-the-art performance for its size.
  • 29
    LTM-2-mini

    LTM-2-mini

    Magic AI

    LTM-2-mini is a 100M token context model: LTM-2-mini. 100M tokens equals ~10 million lines of code or ~750 novels. For each decoded token, LTM-2-mini’s sequence-dimension algorithm is roughly 1000x cheaper than the attention mechanism in Llama 3.1 405B1 for a 100M token context window. The contrast in memory requirements is even larger – running Llama 3.1 405B with a 100M token context requires 638 H100s per user just to store a single 100M token KV cache.2 In contrast, LTM requires a small fraction of a single H100’s HBM per user for the same context.
  • 30
    OpenAI o3-mini-high
    The o3-mini-high model from OpenAI advances AI reasoning by refining deep problem-solving in coding, mathematics, and complex tasks. It features adaptive thinking time with adjustable reasoning modes (low, medium, high) to optimize performance based on task complexity. Outperforming the o1 series by 200 Elo points on Codeforces, it delivers high efficiency at a lower cost while maintaining speed and accuracy. As part of the o3 family, it pushes AI problem-solving boundaries while remaining accessible, offering a free tier and expanded limits for Plus subscribers.