Xorbits Inference Files

Replace OpenAI GPT with another LLM in your app

This is an exact mirror of the Xorbits Inference project, hosted at https://github.com/xorbitsai/inference. SourceForge is not affiliated with Xorbits Inference.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	InfoDownloads / Week
v3.1.0	2026-07-31	2
v3.0.0	2026-07-18	1
v2.12.0	2026-07-03	0
v2.11.0	2026-06-18	0
v2.10.0	2026-06-05	0
Totals: 5 Items		3

Other Useful Business Software

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.

Try It Free

Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.

Try Free

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Try It Free

Recommended Projects

Text Generation Inference
Large Language Model Text Generation Inference
SWIFT LLM
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs
Open Interpreter
A natural language interface for computers
Chitu
High-performance inference framework for large language models
optillm
Optimizing inference proxy for LLMs

Xorbits Inference Files

Replace OpenAI GPT with another LLM in your app

Get an email when there's a new version of Xorbits Inference