Best AI Coding Models for vLLM
View:
Compare the Top AI Coding Models that integrate with vLLM as of November 2026
Sort By:
This a list of AI Coding Models that integrate with vLLM. Use the filters on the left to add additional filters for products that have integrations with vLLM. View the products that work with vLLM in the table below.
What are AI Coding Models for vLLM?
AI coding models are machine learning models specifically trained to assist with software development tasks, such as code generation, bug detection, code completion, and optimization. These models are often built using large datasets of source code and can understand programming languages, patterns, and frameworks. AI coding models can write code based on user prompts, suggest syntax or entire functions, and help developers improve their code through real-time suggestions. Compare and read user reviews of the best AI Coding Models for vLLM currently available using the table below. This list is updated regularly.
-
1
Muse Spark Open
Meta
Muse Spark Open is an open-weight, natively multimodal language model for developers and organizations building AI applications, coding systems, and agentic workflows. The released model has 816 billion total parameters, 42 billion active parameters, and a 1-million-token context window. Teams can download the model weights, run inference through supported engines such as vLLM, SGLang, TensorRT-LLM, Hugging Face Transformers, Apple MLX, llama.cpp, or Unsloth, and customize the model using PyTorch. It supports long-context reasoning, software engineering, coding, tool use, and multimodal inputs. Deployment options include cloud inference through listed API providers or self-hosting on compatible GPU systems; Meta documents a desktop setup using two Apple M5 Ultra Mac Studio computers. The model is released under the Muse Model License with limited commercial terms.Starting Price: $0 -
2
Nemotron 3.5 Super VL
NVIDIA
NVIDIA Nemotron 3.5 Super VL is an open, customizable multimodal AI model designed for complex reasoning, autonomous agents, and enterprise workflows. The model uses a 120-billion-parameter mixture-of-experts architecture that activates approximately 12 billion parameters per token to balance computational efficiency with model capabilities. It combines text, image, document, and video understanding with instruction following, coding, and external tool use. Its multimodal capabilities support document analysis, chart interpretation, optical character recognition, video understanding, and automated information extraction. Developers can customize the model through supervised fine-tuning, low-rank adaptation, and reinforcement learning using NVIDIA NeMo. Nemotron 3.5 Super VL supports deployment in local, cloud, and data center environments for applications such as software engineering, financial document processing, cybersecurity analysis, and enterprise automation.Starting Price: $0 -
3
Nemotron 3.5 Bolt
NVIDIA
NVIDIA Nemotron 3.5 Bolt is a family of open artificial intelligence models designed for local AI agents, autonomous task execution, and conversational applications. The family includes Nemotron 3.5 Bolt 74B-A9B, a 74-billion-parameter mixture-of-experts model with approximately 9 billion active parameters, and Nemotron 3.5 Bolt E4B, a compact model optimized for conversational agents. The 74B-A9B variant uses native 2-bit quantization to operate within approximately 24GB of memory on compatible NVIDIA hardware. Its agentic capabilities support web research, software development, code debugging, and multistep task automation without requiring cloud-based inference. The E4B variant targets local voice assistants, interactive characters, and embedded applications with a 4GB memory footprint. Nemotron 3.5 Bolt supports deployment on NVIDIA RTX systems, DGX Spark, and other compatible hardware, giving developers greater control over inference, application data, and local AI workflows.Starting Price: Free -
4
LFM3
Liquid AI
LFM3 is Liquid AI’s family of compact, open-weight foundation models for text, vision, audio, and multimodal tasks. The release includes text-generation, vision-language, audio, omni, and decision-model variants. Developers can download the model weights, adapt supported models through fine-tuning, and run them locally on edge hardware or access them through Liquid AI’s hosted API. Use cases include conversational assistants, tool calling, speech transcription and generation, image and video understanding, document extraction, classification, routing, and robotics applications. LFM3 is intended for developers, researchers, and organizations building specialized AI applications that need flexible deployment choices, including local inference. Open-weight models are available under Liquid AI’s LFM Open License; commercial eligibility and terms depend on an organization’s annual revenue.Starting Price: $0.08/MTok -
5
Recursive Flint
Recursive
Recursive Flint is a 40-billion-parameter mixture-of-experts language model for agentic coding on local hardware. It activates about 2.5 billion parameters per token and supports reasoning, multi-turn tool use, and context windows up to 512,000 tokens. Developers can use Flint with coding agents to inspect codebases, fix bugs, implement features, and write tests while running inference on their own hardware. Its weights are published under the Apache 2.0 license. Flint works with llama.cpp, Ollama, Unsloth, LM Studio, vLLM, and SGLang; Recursive also provides rec, an inference engine optimized for Apple Silicon M4 Pro and M5 Pro/Max. Setup documentation and examples help developers run the model locally. Flint is for developers and technical teams that want to operate and adapt a code-focused model on their own systems.
- Previous
- You're on page 1
- Next
