optillm Files

Optimizing inference proxy for LLMs

This is an exact mirror of the optillm project, hosted at https://github.com/codelion/optillm. SourceForge is not affiliated with optillm. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2025-06-30	231 Bytes	0
v0.1.18 source code.tar.gz	2025-06-30	730.8 kB	0
v0.1.18 source code.zip	2025-06-30	778.6 kB	0
Totals: 3 Items		1.5 MB	0

What's Changed

Update MLX model patterns and reduce max_tokens in eval script by @codelion in https://github.com/codelion/optillm/pull/205

Full Changelog: https://github.com/codelion/optillm/compare/v0.1.17...v0.1.18

Source: README.md, updated 2025-06-30

Other Useful Business Software

Simplify IT and security with a single endpoint management platform

Automate the hardest parts of IT

NinjaOne automates the hardest parts of IT, delivering visibility, security, and control over all endpoints for more than 20,000 customers. The NinjaOne automated endpoint management platform is proven to increase productivity, reduce security risk, and lower costs for IT teams and managed service providers. The company seamlessly integrates with a wide range of IT and security technologies. NinjaOne is obsessed with customer success and provides free and unlimited onboarding, training, and support.

Learn More

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Recommended Projects

Artificial Intelligence Controller
AICI: Prompts as (Wasm) Programs
Apache OpenOffice
The free and Open Source productivity suite
DeSmuME: Nintendo DS emulator
DeSmuME is a Nintendo DS emulator
KeePass
A lightweight and easy-to-use password manager
7-Zip
A free file archiver for extremely high compression

optillm Files

Optimizing inference proxy for LLMs

Get an email when there's a new version of optillm

What's Changed