any-llm Files

Update Summary

Some fun updates with this one! First off, our docs now are hosted in any-llm.ai: https://any-llm.ai/docs/sdk/providers. We're working on getting that page fully synced up with the docs in this repo (the sync is mostly fixed). Next up, lots of cleanup on the gateway to improve security and add support for models and embeddings endpoints! And last but certainly not least, some good improvements being made to the any-llm-platform integration to give solid options for easy token tracking without needing to ship your actual data through us. Enjoy and as always, let us know in Github or elsewhere with your thoughts. 🙏

What's Changed

• feat(docs): searchable provider card grid with detail modals by @njbrake in https://github.com/mozilla-ai/any-llm/pull/911
• fix(gateway): fix missing exception interpolation in _is_model_free logging by @njbrake in https://github.com/mozilla-ai/any-llm/pull/924
• chore(deps): bump devalue from 5.6.3 to 5.6.4 in /docs by @dependabot[bot] in https://github.com/mozilla-ai/any-llm/pull/912
• refactor(gateway): extract from_model classmethods for response models by @njbrake in https://github.com/mozilla-ai/any-llm/pull/925
• feat(provider): add azureanthropic provider for Claude on Microsoft Foundry by @njbrake in https://github.com/mozilla-ai/any-llm/pull/923
• refactor(gateway): use model_dump(exclude_unset=True) in messages route by @njbrake in https://github.com/mozilla-ai/any-llm/pull/926
• perf(gateway): add compound index on usage_logs(user_id, timestamp) by @njbrake in https://github.com/mozilla-ai/any-llm/pull/927
• fix(gateway): pass consistent timestamp through budget reset by @njbrake in https://github.com/mozilla-ai/any-llm/pull/928
• fix(gateway): use consistent logger in budget.py by @njbrake in https://github.com/mozilla-ai/any-llm/pull/929
• refactor(gateway): extract shared streaming generator utility by @njbrake in https://github.com/mozilla-ai/any-llm/pull/930
• refactor(gateway): extract shared pricing lookup helper by @njbrake in https://github.com/mozilla-ai/any-llm/pull/931
• fix(gateway): support inline env var substitution in YAML config by @njbrake in https://github.com/mozilla-ai/any-llm/pull/932
• fix(gateway): eliminate unnecessary nested transaction in log_usage by @njbrake in https://github.com/mozilla-ai/any-llm/pull/933
• feat(gateway): add GET /v1/models endpoint for OpenAI compatibility by @njbrake in https://github.com/mozilla-ai/any-llm/pull/943
• fix(gateway): improve transaction safety and data integrity by @njbrake in https://github.com/mozilla-ai/any-llm/pull/942
• feat(gateway): add POST /v1/embeddings endpoint by @njbrake in https://github.com/mozilla-ai/any-llm/pull/944
• fix(platform): add OTEL usage tracing to Responses API path by @dpoulopoulos in https://github.com/mozilla-ai/any-llm/pull/949
• fix(gemini): normalize non-object tool responses by @PsiACE in https://github.com/mozilla-ai/any-llm/pull/947
• fix(platform): prevent trace export failures from crashing consumers by @njbrake in https://github.com/mozilla-ai/any-llm/pull/946

New Contributors

• @PsiACE made their first contribution in https://github.com/mozilla-ai/any-llm/pull/947

Full Changelog: https://github.com/mozilla-ai/any-llm/compare/1.11.0...1.11.1