Download Latest Version v1.77.5.rc.4 source code.tar.gz (196.4 MB)
Email in envelope

Get an email when there's a new version of LiteLLM

Home / v1.77.5.rc.2
Name Modified Size InfoDownloads / Week
Parent folder
load_test.html 2025-09-30 1.7 MB
0
load_test_stats.csv 2025-09-30 552 Bytes
0
README.md 2025-09-30 981 Bytes
0
v1.77.5.rc.2 source code.tar.gz 2025-09-30 196.4 MB
0
v1.77.5.rc.2 source code.zip 2025-09-30 198.6 MB
0
Totals: 5 Items   396.6 MB 0

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.77.5-nightly...v1.77.5.rc.2

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.77.5.rc.2

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Failed ❌ 69 91.21311210469347 6.480484157863798 6.480484157863798 1939 1939 56.971296000028815 2990.0553220000174
Aggregated Failed ❌ 69 91.21311210469347 6.480484157863798 6.480484157863798 1939 1939 56.971296000028815 2990.0553220000174
Source: README.md, updated 2025-09-30