optillm Files

Optimizing inference proxy for LLMs

This is an exact mirror of the optillm project, hosted at https://github.com/codelion/optillm. SourceForge is not affiliated with optillm. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2025-11-20	221 Bytes	0
v0.3.9 source code.tar.gz	2025-11-20	1.3 MB	0
v0.3.9 source code.zip	2025-11-20	1.5 MB	0
Totals: 3 Items		2.8 MB	0

What's Changed

Fix max tokens by @codelion in https://github.com/algorithmicsuperintelligence/optillm/pull/280

Full Changelog: https://github.com/algorithmicsuperintelligence/optillm/compare/v0.3.8...v0.3.9

Source: README.md, updated 2025-11-20

Other Useful Business Software

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Stay in Flow. Let Zenflow Handle the Heavy Lifting.

Your AI engineering control center. Zenflow turns specs into shipped features using parallel agents and multi-repo intelligence.

Zenflow is your engineering control center, turning specs into shipped features. Parallel agents handle coding, testing, and refactoring with real repo context. Multi-agent workflows remove bottlenecks and automate routine work so developers stay focused and in flow.

Try free now

Recommended Projects

LazyLLM
Easiest and laziest way for building multi-agent LLMs applications
TensorRT
C++ library for high performance inference on NVIDIA GPUs
vLLM
A high-throughput and memory-efficient inference and serving engine
Xorbits Inference
Replace OpenAI GPT with another LLM in your app
OnnxStream
Lightweight inference library for ONNX files, written in C++

optillm Files

Optimizing inference proxy for LLMs

Get an email when there's a new version of optillm

What's Changed