Best On-Premises Open-Weight AI Models
View:
Compare the Top On-Premises Open-Weight AI Models as of October 2026
Sort By:
What are On-Premises Open-Weight AI Models?
Open-weight AI models are artificial intelligence models whose trained parameters, or weights, are publicly available for developers and organizations to download, deploy, customize, and run on their own infrastructure. These models can support applications such as natural language processing, code generation, reasoning, image generation, speech recognition, multimodal understanding, and autonomous AI agents without requiring exclusive reliance on proprietary model APIs. Open-weight AI models often support fine-tuning, quantization, model distillation, local inference, and deployment across cloud servers, GPUs, edge devices, and on-premises environments. Many models integrate with AI development frameworks, inference engines, model serving platforms, and machine learning tools, allowing organizations to customize performance, control data handling, and optimize infrastructure costs. Unlike fully open-source AI models, open-weight models do not necessarily provide public access to training datasets or source code and may include licensing restrictions on commercial use, redistribution, or modification. Compare and read user reviews of the best On-Premises Open-Weight AI Models currently available using the table below. This list is updated regularly.
-
1
LTX
Lightricks
LTX is an open foundation model for video, audio, and world simulation. You get full control over your AI: run LTX locally on your own hardware, fine tune it on your own IP, and generate video and audio as one unified output instead of stitching together separate tools. The latest model, LTX-2.5, is a 22B-parameter dual-stream diffusion transformer that generates native 4K video at up to 50fps, with synchronized audio and video produced in a single pass. Weights, code, and research are fully open, and independent benchmarking from Artificial Analysis ranks LTX among the top 3 AI video models globally. Access LTX three ways: download the open weights and run it yourself, license the model for on-premise deployment with enterprise support, or build on LTX Studio, the production suite for creative teams and studios. Teams at ElevenLabs, Asteria Film Co., Magnopus, and NVIDIA already build on LTX. LTX is production infrastructure for AI teams generating motion and physical environments inside their own pipelines, not a consumer app for one-off clips.Starting Price: $0 -
2
Muse Spark Open
Meta
Muse Spark Open is an open-weight, natively multimodal language model for developers and organizations building AI applications, coding systems, and agentic workflows. The released model has 816 billion total parameters, 42 billion active parameters, and a 1-million-token context window. Teams can download the model weights, run inference through supported engines such as vLLM, SGLang, TensorRT-LLM, Hugging Face Transformers, Apple MLX, llama.cpp, or Unsloth, and customize the model using PyTorch. It supports long-context reasoning, software engineering, coding, tool use, and multimodal inputs. Deployment options include cloud inference through listed API providers or self-hosting on compatible GPU systems; Meta documents a desktop setup using two Apple M5 Ultra Mac Studio computers. The model is released under the Muse Model License with limited commercial terms.Starting Price: $0 -
3
Nemotron 3.5 Super VL
NVIDIA
NVIDIA Nemotron 3.5 Super VL is an open, customizable multimodal AI model designed for complex reasoning, autonomous agents, and enterprise workflows. The model uses a 120-billion-parameter mixture-of-experts architecture that activates approximately 12 billion parameters per token to balance computational efficiency with model capabilities. It combines text, image, document, and video understanding with instruction following, coding, and external tool use. Its multimodal capabilities support document analysis, chart interpretation, optical character recognition, video understanding, and automated information extraction. Developers can customize the model through supervised fine-tuning, low-rank adaptation, and reinforcement learning using NVIDIA NeMo. Nemotron 3.5 Super VL supports deployment in local, cloud, and data center environments for applications such as software engineering, financial document processing, cybersecurity analysis, and enterprise automation.Starting Price: $0 -
4
Nemotron 3.5 Bolt
NVIDIA
NVIDIA Nemotron 3.5 Bolt is a family of open artificial intelligence models designed for local AI agents, autonomous task execution, and conversational applications. The family includes Nemotron 3.5 Bolt 74B-A9B, a 74-billion-parameter mixture-of-experts model with approximately 9 billion active parameters, and Nemotron 3.5 Bolt E4B, a compact model optimized for conversational agents. The 74B-A9B variant uses native 2-bit quantization to operate within approximately 24GB of memory on compatible NVIDIA hardware. Its agentic capabilities support web research, software development, code debugging, and multistep task automation without requiring cloud-based inference. The E4B variant targets local voice assistants, interactive characters, and embedded applications with a 4GB memory footprint. Nemotron 3.5 Bolt supports deployment on NVIDIA RTX systems, DGX Spark, and other compatible hardware, giving developers greater control over inference, application data, and local AI workflows.Starting Price: Free -
5
GLM-5.3
Z.ai
GLM-5.3 is Z.ai’s frontier coding model designed for complex software engineering, long-horizon agent tasks, and advanced post-training research. The model uses the same base model as GLM-5.2, with improvements coming from scaled post-training across more environments, more diverse tasks, and larger compute investment. GLM-5.3 delivers stronger coding performance, better task ownership, improved benchmark results, and greater efficiency across realistic development workflows. It is built to handle complex coding tasks, production-style engineering work, research environments, automation tasks, and agentic workflows that require multi-step execution. The model also shows emergent cyber capabilities in vulnerability discovery and exploitation-chain reasoning, with safety evaluation and hardening planned before open-weight release.Starting Price: Free -
6
GLM-5.2
Z.ai
GLM-5.2 is an advanced AI foundation model designed to support complex reasoning, coding, and long-range agentic tasks. It helps developers, teams, and organizations build intelligent systems that can understand instructions, solve technical problems, and assist with demanding workflows. The model is especially useful for software engineering, automation, research, and productivity-focused applications. GLM-5.2 is built to handle large amounts of context, making it suitable for projects that require deeper understanding across extended conversations, documents, or codebases. Its mixture-of-experts design helps balance strong performance with more efficient model operation. GLM-5.2 gives businesses and developers a powerful AI tool for creating smarter applications, improving technical workflows, and supporting advanced digital experiences.Starting Price: Free -
7
MiniMax M3
MiniMax
MiniMax M3 is an open-weight multimodal AI model designed for coding, agentic workflows, long-context reasoning, and complex automation tasks. The model combines frontier-level coding performance, native multimodal understanding, and a context window of up to 1 million tokens. MiniMax M3 uses MiniMax Sparse Attention to improve long-context efficiency while reducing compute requirements for large-scale inputs. It supports text, image, and video understanding, making it useful for workflows that combine code, documents, visual references, and tool-driven tasks. The model is built for repository-scale reasoning, software engineering, autonomous task execution, tool calling, and multi-step agent workflows. MiniMax M3 helps developers, AI teams, and enterprises build capable agents that can reason across large contexts and work with multimodal information.Starting Price: $0.30 per million input tokens -
8
Kimi K2.7 Code
Moonshot AI
Kimi K2.7 Code is an open-source, coding-focused agentic AI model developed by Moonshot AI for long-horizon software engineering tasks. It is designed to improve coding performance, agent workflows, and real-world development assistance compared with earlier Kimi K2 versions. The model supports a 256K context window, making it useful for working with large codebases, long technical documents, and complex multi-step programming tasks. Kimi K2.7 Code is available through Kimi Code and API access, with OpenAI- and Anthropic-compatible options for easier integration into developer workflows. It is also listed on Hugging Face and supports deployment through inference engines such as vLLM, SGLang, and KTransformers. With improved agentic capabilities, long-context support, and reduced thinking-token usage compared with K2.6, Kimi K2.7 Code gives developers a flexible open-source option for AI-assisted coding.Starting Price: Free -
9
DeepSeek-V4-Pro
DeepSeek
DeepSeek-V4-Pro is a large-scale Mixture-of-Experts (MoE) language model designed for advanced reasoning, coding, and long-context understanding. It features 1.6 trillion total parameters with 49 billion activated parameters, enabling high performance while maintaining efficiency. The model supports an exceptionally large context window of up to one million tokens, allowing it to process extensive documents and workflows. It uses a hybrid attention architecture to optimize long-context performance and reduce computational cost. DeepSeek-V4-Pro is trained on over 32 trillion tokens, improving its knowledge and reasoning capabilities. It also includes advanced optimization techniques for stability and faster convergence during training. The model supports multiple reasoning modes, allowing users to balance speed and accuracy based on their needs. Overall, it provides a powerful open-source solution for complex AI tasks and large-scale applications.Starting Price: $0.435 per 1M tokens (input) -
10
Wan2.1
Alibaba
Wan2.1 is an open-source suite of advanced video foundation models designed to push the boundaries of video generation. This cutting-edge model excels in various tasks, including Text-to-Video, Image-to-Video, Video Editing, and Text-to-Image, offering state-of-the-art performance across multiple benchmarks. Wan2.1 is compatible with consumer-grade GPUs, making it accessible to a broader audience, and supports multiple languages, including both Chinese and English for text generation. The model's powerful video VAE (Variational Autoencoder) ensures high efficiency and excellent temporal information preservation, making it ideal for generating high-quality video content. Its applications span across entertainment, marketing, and more.Starting Price: Free -
11
DeepSeek R1
DeepSeek
DeepSeek-R1 is an advanced open-source reasoning model developed by DeepSeek, designed to rival OpenAI's Model o1. Accessible via web, app, and API, it excels in complex tasks such as mathematics and coding, demonstrating superior performance on benchmarks like the American Invitational Mathematics Examination (AIME) and MATH. DeepSeek-R1 employs a mixture of experts (MoE) architecture with 671 billion total parameters, activating 37 billion parameters per token, enabling efficient and accurate reasoning capabilities. This model is part of DeepSeek's commitment to advancing artificial general intelligence (AGI) through open-source innovation.Starting Price: Free -
12
Gemma 4
Google
Gemma 4 is an AI model introduced by Google and built on the Gemini architecture to deliver improved performance and flexibility. The model is designed to run efficiently on a single GPU or TPU, making it more accessible to developers and researchers. Gemma 4 enhances capabilities in natural language understanding and text generation, supporting a wide range of AI-driven applications. Its architecture allows it to handle complex tasks while maintaining efficient resource usage. Developers can use the model to build applications that rely on advanced language processing and automation. The design emphasizes scalability so that it can support both smaller projects and larger AI systems. By combining efficiency with powerful language capabilities, Gemma 4 helps advance the development of modern AI solutions.Starting Price: Free -
13
Mistral 7B
Mistral AI
Mistral 7B is a 7.3-billion-parameter language model that outperforms larger models like Llama 2 13B across various benchmarks. It employs Grouped-Query Attention (GQA) for faster inference and Sliding Window Attention (SWA) to efficiently handle longer sequences. Released under the Apache 2.0 license, Mistral 7B is accessible for deployment across diverse platforms, including local environments and major cloud services. Additionally, a fine-tuned version, Mistral 7B Instruct, demonstrates enhanced performance in instruction-following tasks, surpassing models like Llama 2 13B Chat.Starting Price: Free -
14
Kimi K2
Moonshot AI
Kimi K2 is a state-of-the-art open source large language model series built on a mixture-of-experts (MoE) architecture, featuring 1 trillion total parameters and 32 billion activated parameters for task-specific efficiency. Trained with the Muon optimizer on over 15.5 trillion tokens and stabilized by MuonClip’s attention-logit clamping, it delivers exceptional performance in frontier knowledge, reasoning, mathematics, coding, and general agentic workflows. Moonshot AI provides two variants, Kimi-K2-Base for research-level fine-tuning and Kimi-K2-Instruct pre-trained for immediate chat and tool-driven interactions, enabling both custom development and drop-in agentic capabilities. Benchmarks show it outperforms leading open source peers and rivals top proprietary models in coding tasks and complex task breakdowns, while its 128 K-token context length, tool-calling API compatibility, and support for industry-standard inference engines.Starting Price: Free -
15
Kimi K2 Thinking
Moonshot AI
Kimi K2 Thinking is an advanced open source reasoning model developed by Moonshot AI, designed specifically for long-horizon, multi-step workflows where the system interleaves chain-of-thought processes with tool invocation across hundreds of sequential tasks. The model uses a mixture-of-experts architecture with a total of 1 trillion parameters, yet only about 32 billion parameters are activated per inference pass, optimizing efficiency while maintaining vast capacity. It supports a context window of up to 256,000 tokens, enabling the handling of extremely long inputs and reasoning chains without losing coherence. Native INT4 quantization is built in, which reduces inference latency and memory usage without performance degradation. Kimi K2 Thinking is explicitly built for agentic workflows; it can autonomously call external tools, manage sequential logic steps (up to and typically between 200-300 tool calls in a single chain), and maintain consistent reasoning.Starting Price: Free -
16
Mistral Large 3
Mistral AI
Mistral Large 3 is a next-generation, open multimodal AI model built with a powerful sparse Mixture-of-Experts architecture featuring 41B active parameters out of 675B total. Designed from scratch on NVIDIA H200 GPUs, it delivers frontier-level reasoning, multilingual performance, and advanced image understanding while remaining fully open-weight under the Apache 2.0 license. The model achieves top-tier results on modern instruction benchmarks, positioning it among the strongest permissively licensed foundation models available today. With native support across vLLM, TensorRT-LLM, and major cloud providers, Mistral Large 3 offers exceptional accessibility and performance efficiency. Its design enables enterprise-grade customization, letting teams fine-tune or adapt the model for domain-specific workflows and proprietary applications. Mistral Large 3 represents a major advancement in open AI, offering frontier intelligence without sacrificing transparency or control.Starting Price: Free -
17
Kimi K2.5
Moonshot AI
Kimi K2.5 is a next-generation multimodal AI model designed for advanced reasoning, coding, and visual understanding tasks. It features a native multimodal architecture that supports both text and visual inputs, enabling image and video comprehension alongside natural language processing. Kimi K2.5 delivers open-source state-of-the-art performance in agent workflows, software development, and general intelligence tasks. The model offers ultra-long context support with a 256K token window, making it suitable for large documents and complex conversations. It includes long-thinking capabilities that allow multi-step reasoning and tool invocation for solving challenging problems. Kimi K2.5 is fully compatible with the OpenAI API format, allowing developers to switch seamlessly with minimal changes. With strong performance, flexibility, and developer-focused tooling, Kimi K2.5 is built for production-grade AI applications.Starting Price: Free -
18
GLM-5
Z.ai
GLM-5 is Z.ai’s latest large language model built for complex systems engineering and long-horizon agentic tasks. It scales significantly beyond GLM-4.5, increasing total parameters and training data while integrating DeepSeek Sparse Attention to reduce deployment costs without sacrificing long-context capacity. The model combines enhanced pre-training with a new asynchronous reinforcement learning infrastructure called slime, improving training efficiency and post-training refinement. GLM-5 achieves best-in-class performance among open-source models across reasoning, coding, and agent benchmarks, narrowing the gap with leading frontier models. It ranks highly on evaluations such as Vending Bench 2, demonstrating strong long-term planning and operational capabilities. The model is open-sourced under the MIT License.Starting Price: Free -
19
GLM-5.1
Z.ai
GLM-5.1 is the latest iteration of Z.ai’s GLM series, designed as a frontier-level, agent-oriented AI model optimized for coding, reasoning, and long-horizon workflows. It builds on the GLM-5 architecture, which uses a Mixture-of-Experts (MoE) design to deliver high performance while keeping inference costs efficient, and is part of a broader push toward open-weight, developer-accessible models. A core focus of GLM-5.1 is enabling agentic behavior, meaning it can plan, execute, and iterate across multi-step tasks rather than simply responding to single prompts. It is specifically designed to handle complex workflows such as debugging code, navigating repositories, and executing chained operations with sustained context. Compared to earlier models, GLM-5.1 improves reliability in long interactions, maintaining coherence across extended sessions and reducing breakdowns in multi-step reasoning.Starting Price: Free -
20
Kimi K2.6
Moonshot AI
Kimi K2.6 is a next-generation agentic AI model developed by Moonshot AI, designed to push forward real-world execution, coding, and multi-step reasoning beyond earlier K2 and K2.5 versions. It builds on a Mixture-of-Experts architecture and the multimodal, agent-first foundation of the Kimi series, combining language understanding, coding, and tool use into a single system capable of planning and executing complex workflows. It introduces deeper reasoning capabilities and significantly improved agent planning, allowing it to break down tasks, coordinate tools, and handle multi-file or multi-step problems with greater accuracy and efficiency. It supports advanced tool calling with high reliability, enabling integration with external systems such as web search or APIs, and includes built-in validation mechanisms to ensure correct execution formats.Starting Price: Free -
21
Falcon-40B
Technology Innovation Institute (TII)
Falcon-40B is a 40B parameters causal decoder-only model built by TII and trained on 1,000B tokens of RefinedWeb enhanced with curated corpora. It is made available under the Apache 2.0 license. Why use Falcon-40B? It is the best open-source model currently available. Falcon-40B outperforms LLaMA, StableLM, RedPajama, MPT, etc. See the OpenLLM Leaderboard. It features an architecture optimized for inference, with FlashAttention and multiquery. It is made available under a permissive Apache 2.0 license allowing for commercial use, without any royalties or restrictions. ⚠️ This is a raw, pretrained model, which should be further finetuned for most usecases. If you are looking for a version better suited to taking generic instructions in a chat format, we recommend taking a look at Falcon-40B-Instruct.Starting Price: Free -
22
Baichuan-13B
Baichuan Intelligent Technology
Baichuan-13B is an open source and commercially available large-scale language model containing 13 billion parameters developed by Baichuan Intelligent following Baichuan -7B . It has achieved the best results of the same size on authoritative Chinese and English benchmarks. This release contains two versions of pre-training ( Baichuan-13B-Base ) and alignment ( Baichuan-13B-Chat ). Larger size, more data : Baichuan-13B further expands the number of parameters to 13 billion on the basis of Baichuan -7B , and trains 1.4 trillion tokens on high-quality corpus, which is 40% more than LLaMA-13B. It is currently open source The model with the largest amount of training data in the 13B size. Support Chinese and English bilingual, use ALiBi position code, context window length is 4096.Starting Price: Free -
23
Mixtral 8x7B
Mistral AI
Mixtral 8x7B is a high-quality sparse mixture of experts model (SMoE) with open weights. Licensed under Apache 2.0. Mixtral outperforms Llama 2 70B on most benchmarks with 6x faster inference. It is the strongest open-weight model with a permissive license and the best model overall regarding cost/performance trade-offs. In particular, it matches or outperforms GPT-3.5 on most standard benchmarks.Starting Price: Free -
24
Codestral
Mistral AI
We introduce Codestral, our first-ever code model. Codestral is an open-weight generative AI model explicitly designed for code generation tasks. It helps developers write and interact with code through a shared instruction and completion API endpoint. As it masters code and English, it can be used to design advanced AI applications for software developers. Codestral is trained on a diverse dataset of 80+ programming languages, including the most popular ones, such as Python, Java, C, C++, JavaScript, and Bash. It also performs well on more specific ones like Swift and Fortran. This broad language base ensures Codestral can assist developers in various coding environments and projects.Starting Price: Free -
25
Llama 3.2
Meta
The open-source AI model you can fine-tune, distill and deploy anywhere is now available in more versions. Choose from 1B, 3B, 11B or 90B, or continue building with Llama 3.1. Llama 3.2 is a collection of large language models (LLMs) pretrained and fine-tuned in 1B and 3B sizes that are multilingual text only, and 11B and 90B sizes that take both text and image inputs and output text. Develop highly performative and efficient applications from our latest release. Use our 1B or 3B models for on device applications such as summarizing a discussion from your phone or calling on-device tools like calendar. Use our 11B or 90B models for image use cases such as transforming an existing image into something new or getting more information from an image of your surroundings.Starting Price: Free -
26
Janus-Pro-7B
DeepSeek
Janus-Pro-7B is an innovative open-source multimodal AI model from DeepSeek, designed to excel in both understanding and generating content across text, images, and videos. It leverages a unique autoregressive architecture with separate pathways for visual encoding, enabling high performance in tasks ranging from text-to-image generation to complex visual comprehension. This model outperforms competitors like DALL-E 3 and Stable Diffusion in various benchmarks, offering scalability with versions from 1 billion to 7 billion parameters. Licensed under the MIT License, Janus-Pro-7B is freely available for both academic and commercial use, providing a significant leap in AI capabilities while being accessible on major operating systems like Linux, MacOS, and Windows through Docker.Starting Price: Free -
27
DeepSeek-V2
DeepSeek
DeepSeek-V2 is a state-of-the-art Mixture-of-Experts (MoE) language model introduced by DeepSeek-AI, characterized by its economical training and efficient inference capabilities. With a total of 236 billion parameters, of which only 21 billion are active per token, it supports a context length of up to 128K tokens. DeepSeek-V2 employs innovative architectures like Multi-head Latent Attention (MLA) for efficient inference by compressing the Key-Value (KV) cache and DeepSeekMoE for cost-effective training through sparse computation. This model significantly outperforms its predecessor, DeepSeek 67B, by saving 42.5% in training costs, reducing the KV cache by 93.3%, and enhancing generation throughput by 5.76 times. Pretrained on an 8.1 trillion token corpus, DeepSeek-V2 excels in language understanding, coding, and reasoning tasks, making it a top-tier performer among open-source models.Starting Price: Free -
28
Falcon Mamba 7B
Technology Innovation Institute (TII)
Falcon Mamba 7B is the first open-source State Space Language Model (SSLM), introducing a groundbreaking architecture for Falcon models. Recognized as the top-performing open-source SSLM worldwide by Hugging Face, it sets a new benchmark in AI efficiency. Unlike traditional transformers, SSLMs operate with minimal memory requirements and can generate extended text sequences without additional overhead. Falcon Mamba 7B surpasses leading transformer-based models, including Meta’s Llama 3.1 8B and Mistral’s 7B, showcasing superior performance. This innovation underscores Abu Dhabi’s commitment to advancing AI research and development on a global scale.Starting Price: Free -
29
R1 1776
Perplexity AI
Perplexity AI has open-sourced R1 1776, a large language model (LLM) based on DeepSeek R1 designed to enhance transparency and foster community collaboration in AI development. This release allows researchers and developers to access the model's architecture and codebase, enabling them to contribute to its improvement and adaptation for various applications. By sharing R1 1776 openly, Perplexity AI aims to promote innovation and ethical practices within the AI community.Starting Price: Free -
30
QwQ-Max-Preview
Alibaba
QwQ-Max-Preview is an advanced AI model built on the Qwen2.5-Max architecture, designed to excel in deep reasoning, mathematical problem-solving, coding, and agent-related tasks. This preview version offers a sneak peek at its capabilities, which include improved performance in a wide range of general-domain tasks and the ability to handle complex workflows. QwQ-Max-Preview is slated for an official open-source release under the Apache 2.0 license, offering further advancements and refinements in its full version. It also paves the way for a more accessible AI ecosystem, with the upcoming launch of the Qwen Chat app and smaller variants of the model like QwQ-32B, aimed at developers seeking local deployment options.Starting Price: Free
