optillm Files

Optimizing inference proxy for LLMs

This is an exact mirror of the optillm project, hosted at https://github.com/codelion/optillm. SourceForge is not affiliated with optillm. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2025-12-25	235 Bytes	0
v0.3.12 source code.tar.gz	2025-12-25	1.3 MB	0
v0.3.12 source code.zip	2025-12-25	1.5 MB	0
Totals: 3 Items		2.8 MB	0

What's Changed

Fix default addres binding by @codelion in https://github.com/algorithmicsuperintelligence/optillm/pull/288

Full Changelog: https://github.com/algorithmicsuperintelligence/optillm/compare/v0.3.11...v0.3.12

Source: README.md, updated 2025-12-25

Other Useful Business Software

Auth0 for AI Agents now in GA

Ready to implement AI with confidence (without sacrificing security)?

Connect your AI agents to apps and data more securely, give users control over the actions AI agents can perform and the data they can access, and enable human confirmation for critical agent actions.

Start building today

Cloud-based help desk software with ServoDesk

Full access to Enterprise features. No credit card required.

What if You Could Automate 90% of Your Repetitive Tasks in Under 30 Days? At ServoDesk, we help businesses like yours automate operations with AI, allowing you to cut service times in half and increase productivity by 25% - without hiring more staff.

Try ServoDesk for free

Recommended Projects

FlashInfer
FlashInfer: Kernel Library for LLM Serving
LazyLLM
Easiest and laziest way for building multi-agent LLMs applications
TensorRT
C++ library for high performance inference on NVIDIA GPUs
Turing.jl
Bayesian inference with probabilistic programming
vLLM
A high-throughput and memory-efficient inference and serving engine

optillm Files

Optimizing inference proxy for LLMs

Get an email when there's a new version of optillm

What's Changed