Audience

AI platform engineers building production LLM systems that need one open source stack for routing, observability, evaluation, optimization, and experimentation

About TensorZero

TensorZero is an open source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation. It creates a feedback loop for optimizing LLM applications, turning production metrics and human feedback into smarter, faster, and cheaper models and agents. The gateway lets teams integrate once and access every major LLM provider through a single unified API, including API and self-hosted models, with support for tool use, structured outputs, batch inference, embeddings, multimodal inputs, caching, routing, retries, fallbacks, load balancing, granular timeouts, usage tracking, custom rate limits, and provider-key protection. Built for performance in Rust, TensorZero is designed for extreme throughput and low-latency production workloads while still letting teams adopt only the components they need. Its observability layer stores inferences and feedback in the user’s own database, available programmatically or through the open source UI.

Pricing

Starting Price:
Free
Free Version:
Free Version available.

Integrations

API:
Yes, TensorZero offers API access
No integrations listed.

Ratings/Reviews

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Company Information

TensorZero
Founded: 2023
United States
github.com/tensorzero/tensorzero

Videos and Screen Captures

TensorZero Screenshot 1
Other Useful Business Software
Our Free Plans just got better! | Auth0 Icon
Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Try free now

Product Details

Platforms Supported
Cloud
Training
Documentation
Videos
Support
Online

TensorZero Frequently Asked Questions

Q: What kinds of users and organization types does TensorZero work with?
Q: What languages does TensorZero support in their product?
Q: What kind of support options does TensorZero offer?
Q: Does TensorZero have an API?
Q: What type of training does TensorZero provide?
Q: How much does TensorZero cost?

TensorZero Product Features