Paddler Files

Open-source LLM load balancer and serving platform for hosting LLMs

This is an exact mirror of the Paddler project, hosted at https://github.com/intentee/paddler. SourceForge is not affiliated with Paddler.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
paddler-bin-linux-libc2.35-amd64	2026-07-19	37.7 MB	0
paddler-bin-linux-libc2.39-amd64	2026-07-19	37.9 MB	0
paddler-bin-macos-arm	2026-07-19	34.4 MB	0
paddler-gui-bin-linux-libc2.35-amd64	2026-07-19	53.5 MB	0
paddler-gui-bin-linux-libc2.39-amd64	2026-07-19	53.7 MB	0
paddler-gui-bin-macos-arm	2026-07-19	42.9 MB	0
README.md	2026-07-19	467 Bytes	0
v4.1.0 (OpenCode support) source code.tar.gz	2026-07-19	1.4 MB	0
v4.1.0 (OpenCode support) source code.zip	2026-07-19	2.0 MB	0
Totals: 9 Items		263.5 MB	0

Features

Add support for OpenCode - howto here: https://github.com/intentee/paddler/issues/253#issuecomment-4980764877
Bump internal llama.cpp to b10068

Internals

Thread CancellationToken through all the Paddler APIs, so everything can be canceled cleanly in paddler_client

Source: README.md, updated 2026-07-19

Other Useful Business Software

Ship Agents Faster Icon

Ship Agents Faster

Transform your applications and workflows into powerful agentic systems at global scale.

Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.

Get Started Free

MongoDB Atlas runs apps anywhere Icon

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Ship Agents Faster

Transform your applications and workflows into powerful agentic systems at global scale.

Gemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.

Get Started Free

Recommended Projects

Chitu
High-performance inference framework for large language models
GPUStack
Performance-optimized AI inference on your GPUs
uzu
A high-performance inference engine for AI models
llama2.c
Inference Llama 2 in one file of pure C
FlashInfer
FlashInfer: Kernel Library for LLM Serving