LLMeter

LLMetrics is LLM cost tracking software for teams shipping AI products, bringing model spend, token usage, feature attribution, and usage alerts into one live dashboard. It supports more than 100 models across OpenAI, Anthropic, Google Gemini, Mistral, Cohere, Together AI, Groq, and other providers, with pricing data synchronized daily. Teams tag each model call with a feature name, provider, model, input tokens, and output tokens, allowing them to see exactly whether a chatbot, summarizer, search feature, lesson generator, or other workflow is driving spend. Real-time updates and daily trend charts reveal how costs change after releases, prompt edits, traffic growth, or model swaps. Spend thresholds and spike-detection rules can alert teams through email or Slack when usage patterns look wrong, helping them catch runaway loops and unexpected cost increases before the provider invoice arrives.

Spanlens is an open-source (MIT) LLM observability platform that lets developers monitor every call their application makes to OpenAI, Anthropic, Gemini, Mistral, OpenRouter, Azure OpenAI, or a local Ollama model. Integration takes one line: swap your client's baseURL to the Spanlens proxy, or run "npx @spanlens/cli init" and the wizard rewrites your code automatically. From that moment, every request is recorded with its model, token counts, latency, cost, and full prompt and response body, with streaming responses reconstructed automatically. The dashboard turns that raw log into operational insight. Cost tracking breaks spend down per request, per model, and per end user, and parses prompt-cache tokens separately so you see real cache savings rather than sticker price. Agent tracing visualizes multi-step workflows as Gantt waterfalls and node-and-edge graphs, highlighting the critical path so you can find the slowest dependency chain in a fan-out.