oMLX Files

LLM inference server with continuous batching & SSD caching

This is an exact mirror of the oMLX project, hosted at https://github.com/jundot/omlx. SourceForge is not affiliated with oMLX.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
v0.6.3rc1	< 18 hours ago		0
v0.6.2	2026-08-18		0
v0.6.1	2026-08-17		0
v0.6.0	2026-08-16		0
v0.6.0rc1	2026-08-15		0
Totals: 5 Items			0

Other Useful Business Software

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.

Try It Free

Cut Data Warehouse Costs by 54%

Easily migrate from Snowflake, Redshift, or Databricks with free tools.

BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.

Try Free

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Try It Free

Recommended Projects

LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference
LitServe
Minimal Python framework for scalable AI inference servers fast
uzu
A high-performance inference engine for AI models
tiny-llm
A course of learning LLM inference serving on Apple Silicon
Infinity
Low-latency REST API for serving text-embeddings

oMLX Files

LLM inference server with continuous batching & SSD caching

Get an email when there's a new version of oMLX