optillm Files

Optimizing inference proxy for LLMs

This is an exact mirror of the optillm project, hosted at https://github.com/codelion/optillm. SourceForge is not affiliated with optillm.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
v0.3.22	2026-07-18		0
v0.3.21	2026-07-05		0
v0.3.20	2026-07-05		0
v0.3.19	2026-07-05		0
v0.3.18	2026-07-05		0
Totals: 5 Items			0

Other Useful Business Software

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.

Try It Free

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Try It Free

Recommended Projects

gemma.cpp
lightweight, standalone C++ inference engine for Google's Gemma models
TensorRT
C++ library for high performance inference on NVIDIA GPUs
OnnxStream
Lightweight inference library for ONNX files, written in C++
FlashInfer
FlashInfer: Kernel Library for LLM Serving
LazyLLM
Easiest and laziest way for building multi-agent LLMs applications

optillm Files

Optimizing inference proxy for LLMs

Get an email when there's a new version of optillm