Download Latest Version v1.77.5.rc.4 source code.tar.gz (196.4 MB)
Email in envelope

Get an email when there's a new version of LiteLLM

Home / v1.77.5.rc.3
Name Modified Size InfoDownloads / Week
Parent folder
load_test.html 2025-10-01 1.7 MB
load_test_stats.csv 2025-10-01 552 Bytes
README.md 2025-09-30 978 Bytes
v1.77.5.rc.3 source code.tar.gz 2025-09-30 196.4 MB
v1.77.5.rc.3 source code.zip 2025-09-30 198.6 MB
Totals: 5 Items   396.6 MB 0

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.77.5.rc.2...v1.77.5.rc.3

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.77.5.rc.3

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Failed ❌ 61 81.2673916810391 6.4330281962332565 6.4330281962332565 1925 1925 44.94549700001471 2565.9705129999966
Aggregated Failed ❌ 61 81.2673916810391 6.4330281962332565 6.4330281962332565 1925 1925 44.94549700001471 2565.9705129999966
Source: README.md, updated 2025-09-30