flo2

flo2

Data Products LLP
+
+

Related Products

  • Cloudflare
    2,026 Ratings
    Visit Website
  • Grafana Cloud
    853 Ratings
    Visit Website
  • UTunnel VPN and ZTNA
    118 Ratings
    Visit Website
  • KrakenD
    71 Ratings
    Visit Website
  • Gemini Enterprise Agent Platform
    984 Ratings
    Visit Website
  • Thinfinity Workspace
    14 Ratings
    Visit Website
  • Passwork
    117 Ratings
    Visit Website
  • New Relic
    2,923 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Juspay
    17 Ratings
    Visit Website

About

TensorZero is an open source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation. It creates a feedback loop for optimizing LLM applications, turning production metrics and human feedback into smarter, faster, and cheaper models and agents. The gateway lets teams integrate once and access every major LLM provider through a single unified API, including API and self-hosted models, with support for tool use, structured outputs, batch inference, embeddings, multimodal inputs, caching, routing, retries, fallbacks, load balancing, granular timeouts, usage tracking, custom rate limits, and provider-key protection. Built for performance in Rust, TensorZero is designed for extreme throughput and low-latency production workloads while still letting teams adopt only the components they need. Its observability layer stores inferences and feedback in the user’s own database, available programmatically or through the open source UI.

About

flo2 is an LLM gateway and router that provides access to major AI model providers (OpenAI, Anthropic, Groq, Cerebras, DeepInfra) through one unified, OpenAI-compatible API. Smart routing picks the cheapest or fastest model per request. Automatic fallback keeps applications running when a provider goes down. Racing mode runs requests across providers in parallel. Full cost accounting per request, per model, per project. Developers use their own provider keys via flo2.com — RapidAPI's testing tier includes free tokens for evaluation.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

AI platform engineers building production LLM systems that need one open source stack for routing, observability, evaluation, optimization, and experimentation

Audience

Backend developers and AI engineers who already use LLM APIs in production and pay for them directly.

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

No images available

Pricing

Free
Free Version
Free Trial

Pricing

0
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

TensorZero
Founded: 2023
United States
github.com/tensorzero/tensorzero

Company Information

Data Products LLP
Founded: 2026
United Kingdom
flo2.com

Alternatives

Alternatives

Categories

Categories

Integrations

Anthropic
Cerebras
Groq
OpenAI

Integrations

Anthropic
Cerebras
Groq
OpenAI
Claim TensorZero and update features and information
Claim TensorZero and update features and information
Claim flo2 and update features and information
Claim flo2 and update features and information