Xorbits Inference Files

Replace OpenAI GPT with another LLM in your app

This is an exact mirror of the Xorbits Inference project, hosted at https://github.com/xorbitsai/inference. SourceForge is not affiliated with Xorbits Inference. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2025-10-20	566 Bytes	0
v1.11.0.post1 source code.tar.gz	2025-10-20	53.9 MB	0
v1.11.0.post1 source code.zip	2025-10-20	54.9 MB	0
Totals: 3 Items		108.8 MB	0

What's new in 1.11.0.post1 (2025-10-20)

These are the changes in inference v1.11.0.post1.

Bug fixes

BUG: repair qwen3 model transformers random characters by @OliverBryant in https://github.com/xorbitsai/inference/pull/4148
BUG: [UI] resolve progress bar display issue. by @yiboyasss in https://github.com/xorbitsai/inference/pull/4150

Others

BLD：fix transformers version in cu128 dockerfile by @zwt-1234 in https://github.com/xorbitsai/inference/pull/4152

Full Changelog: https://github.com/xorbitsai/inference/compare/v1.11.0...v1.11.0.post1

Source: README.md, updated 2025-10-20

Other Useful Business Software

Gen AI apps are built with MongoDB Atlas

The database for AI-powered applications.

MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.

Start Free

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Recommended Projects

Text Generation Inference
Large Language Model Text Generation Inference
LazyLLM
Easiest and laziest way for building multi-agent LLMs applications
Open Interpreter
A natural language interface for computers
SageMaker Hugging Face Inference Toolkit
Library for serving Transformers models on Amazon SageMaker
Gen.jl
A general-purpose probabilistic programming system

Xorbits Inference Files

Replace OpenAI GPT with another LLM in your app

Get an email when there's a new version of Xorbits Inference

What's new in 1.11.0.post1 (2025-10-20)

Bug fixes

Others