Compare the Top Open-Weight AI Models that integrate with Baseten as of October 2026

This a list of Open-Weight AI Models that integrate with Baseten. Use the filters on the left to add additional filters for products that have integrations with Baseten. View the products that work with Baseten in the table below.

What are Open-Weight AI Models for Baseten?

Open-weight AI models are artificial intelligence models whose trained parameters, or weights, are publicly available for developers and organizations to download, deploy, customize, and run on their own infrastructure. These models can support applications such as natural language processing, code generation, reasoning, image generation, speech recognition, multimodal understanding, and autonomous AI agents without requiring exclusive reliance on proprietary model APIs. Open-weight AI models often support fine-tuning, quantization, model distillation, local inference, and deployment across cloud servers, GPUs, edge devices, and on-premises environments. Many models integrate with AI development frameworks, inference engines, model serving platforms, and machine learning tools, allowing organizations to customize performance, control data handling, and optimize infrastructure costs. Unlike fully open-source AI models, open-weight models do not necessarily provide public access to training datasets or source code and may include licensing restrictions on commercial use, redistribution, or modification. Compare and read user reviews of the best Open-Weight AI Models for Baseten currently available using the table below. This list is updated regularly.

  • 1
    Muse Spark Open
    Muse Spark Open is an open-weight, natively multimodal language model for developers and organizations building AI applications, coding systems, and agentic workflows. The released model has 816 billion total parameters, 42 billion active parameters, and a 1-million-token context window. Teams can download the model weights, run inference through supported engines such as vLLM, SGLang, TensorRT-LLM, Hugging Face Transformers, Apple MLX, llama.cpp, or Unsloth, and customize the model using PyTorch. It supports long-context reasoning, software engineering, coding, tool use, and multimodal inputs. Deployment options include cloud inference through listed API providers or self-hosting on compatible GPU systems; Meta documents a desktop setup using two Apple M5 Ultra Mac Studio computers. The model is released under the Muse Model License with limited commercial terms.
    Starting Price: $0
  • 2
    Nemotron 3.5 Bolt
    NVIDIA Nemotron 3.5 Bolt is a family of open artificial intelligence models designed for local AI agents, autonomous task execution, and conversational applications. The family includes Nemotron 3.5 Bolt 74B-A9B, a 74-billion-parameter mixture-of-experts model with approximately 9 billion active parameters, and Nemotron 3.5 Bolt E4B, a compact model optimized for conversational agents. The 74B-A9B variant uses native 2-bit quantization to operate within approximately 24GB of memory on compatible NVIDIA hardware. Its agentic capabilities support web research, software development, code debugging, and multistep task automation without requiring cloud-based inference. The E4B variant targets local voice assistants, interactive characters, and embedded applications with a 4GB memory footprint. Nemotron 3.5 Bolt supports deployment on NVIDIA RTX systems, DGX Spark, and other compatible hardware, giving developers greater control over inference, application data, and local AI workflows.
    Starting Price: Free
  • 3
    DeepSeek R1

    DeepSeek R1

    DeepSeek

    DeepSeek-R1 is an advanced open-source reasoning model developed by DeepSeek, designed to rival OpenAI's Model o1. Accessible via web, app, and API, it excels in complex tasks such as mathematics and coding, demonstrating superior performance on benchmarks like the American Invitational Mathematics Examination (AIME) and MATH. DeepSeek-R1 employs a mixture of experts (MoE) architecture with 671 billion total parameters, activating 37 billion parameters per token, enabling efficient and accurate reasoning capabilities. This model is part of DeepSeek's commitment to advancing artificial general intelligence (AGI) through open-source innovation.
    Starting Price: Free
  • 4
    Tülu 3
    Tülu 3 is an advanced instruction-following language model developed by the Allen Institute for AI (Ai2), designed to enhance capabilities in areas such as knowledge, reasoning, mathematics, coding, and safety. Built upon the Llama 3 Base, Tülu 3 employs a comprehensive four-stage post-training process: meticulous prompt curation and synthesis, supervised fine-tuning on a diverse set of prompts and completions, preference tuning using both off- and on-policy data, and a novel reinforcement learning approach to bolster specific skills with verifiable rewards. This open-source model distinguishes itself by providing full transparency, including access to training data, code, and evaluation tools, thereby closing the performance gap between open and proprietary fine-tuning methods. Evaluations indicate that Tülu 3 outperforms other open-weight models of similar size, such as Llama 3.1-Instruct and Qwen2.5-Instruct, across various benchmarks.
    Starting Price: Free
  • 5
    Llama 3.2
    The open-source AI model you can fine-tune, distill and deploy anywhere is now available in more versions. Choose from 1B, 3B, 11B or 90B, or continue building with Llama 3.1. Llama 3.2 is a collection of large language models (LLMs) pretrained and fine-tuned in 1B and 3B sizes that are multilingual text only, and 11B and 90B sizes that take both text and image inputs and output text. Develop highly performative and efficient applications from our latest release. Use our 1B or 3B models for on device applications such as summarizing a discussion from your phone or calling on-device tools like calendar. Use our 11B or 90B models for image use cases such as transforming an existing image into something new or getting more information from an image of your surroundings.
    Starting Price: Free
  • 6
    Qwen3

    Qwen3

    Alibaba

    Qwen3, the latest iteration of the Qwen family of large language models, introduces groundbreaking features that enhance performance across coding, math, and general capabilities. With models like the Qwen3-235B-A22B and Qwen3-30B-A3B, Qwen3 achieves impressive results compared to top-tier models, thanks to its hybrid thinking modes that allow users to control the balance between deep reasoning and quick responses. The platform supports 119 languages and dialects, making it an ideal choice for global applications. Its pre-training process, which uses 36 trillion tokens, enables robust performance, and advanced reinforcement learning (RL) techniques continue to refine its capabilities. Available on platforms like Hugging Face and ModelScope, Qwen3 offers a powerful tool for developers and researchers working in diverse fields.
    Starting Price: Free
  • Previous
  • You're on page 1
  • Next