Xorbits Inference Files

Replace OpenAI GPT with another LLM in your app

This is an exact mirror of the Xorbits Inference project, hosted at https://github.com/xorbitsai/inference. SourceForge is not affiliated with Xorbits Inference. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2025-06-13	399 Bytes	0
v1.7.0.post1 source code.tar.gz	2025-06-13	32.6 MB	0
v1.7.0.post1 source code.zip	2025-06-13	33.4 MB	2
Totals: 3 Items		66.0 MB	2

What's new in 1.7.0.post1 (2025-06-13)

These are the changes in inference v1.7.0.post1.

Bug fixes

BUG: fix qwen3-rerank to create model on GPU by @qinxuye in https://github.com/xorbitsai/inference/pull/3630
BUG: fix mincpm4 modeling by @Jun-Howie in https://github.com/xorbitsai/inference/pull/3632

Full Changelog: https://github.com/xorbitsai/inference/compare/v1.7.0...v1.7.0.post1

Source: README.md, updated 2025-06-13

Other Useful Business Software

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

MongoDB 8.0 on Atlas | Run anywhere

Now available in even more cloud regions across AWS, Azure, and Google Cloud.

MongoDB 8.0 brings enhanced performance and flexibility to Atlas—with expanded availability across 125+ regions globally. Build modern apps anywhere your users are, with the power of a modern database behind you.

Learn More

Recommended Projects

AgentOps
Python SDK for agent monitoring, LLM cost tracking, benchmarking, etc.
Clonezilla
A partition and disk imaging/cloning program
7-Zip
A free file archiver for extremely high compression
DeSmuME: Nintendo DS emulator
DeSmuME is a Nintendo DS emulator
KeePass
A lightweight and easy-to-use password manager

Xorbits Inference Files

Replace OpenAI GPT with another LLM in your app

Get an email when there's a new version of Xorbits Inference

What's new in 1.7.0.post1 (2025-06-13)

Bug fixes