Search Results for "api monitor"

An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease. With OpenLLM, you can run inference with any open-source large-language models, deploy to the cloud or on-premises, and build powerful AI apps. Built-in supports a wide range of open-source LLMs and model runtime, including Llama 2， StableLM, Falcon, Dolly, Flan-T5, ChatGLM, StarCoder, and more. Serve LLMs over RESTful API or gRPC with one command, query via WebUI, CLI, our Python/Javascript client, or any HTTP client.

...Conversations can resume after restarts or temporary CLI disconnections. Multiple named overlays can run at once and collapse into labeled draggable orbs. It uses the user’s existing Claude subscription rather than a separate API key.

...It works by counting tokens in prompts and responses before or after sending requests and then applying pricing information associated with different models. This allows engineers building AI applications, chatbots, or autonomous agents to monitor and predict API expenses during development and production. The library includes pricing information for hundreds of language models and is frequently updated to reflect pricing changes from major AI providers.

Unstract is a powerful open-source, no-code platform built to automate the extraction and structuring of unstructured documents using large language models and flexible workflows, enabling developers and data teams to turn messy files into organized JSON content without complex coding. It integrates a visual Prompt Studio environment where users can iteratively design extraction schemas, compare outputs from different models, and monitor costs and accuracy side by side, making it easier to refine prompts and extraction logic before deploying at scale. Unstract supports deploying structured extraction as REST API endpoints or embedding it into data engineering ETL pipelines, which allows it to plug directly into data warehouses, cloud storage, or downstream analytics systems. ...

AnyModelBot is a free, open-source, local-first AI agent platform that allows users to create personalized AI assistants powered by a wide variety of large language models. The application supports more than 70 models, including GPT, Claude, Gemini, Grok, DeepSeek, Kimi, and GLM, through a unified Modelflare integration with pay-as-you-go pricing. Users can create multiple AI bots with unique personalities, dedicated workspaces, persistent memory, and configurable permissions for executing...

SuggestArr is an open-source automation platform designed to recommend and automatically request movies, TV shows, and anime based on a user’s viewing history in self-hosted media servers. The project integrates with popular media management systems such as Jellyfin, Plex, and Emby, allowing it to analyze recently watched content and identify similar titles using metadata from the TMDb database. Once potential recommendations are identified, SuggestArr can automatically send download or...

Swirl queries any number of data sources with APIs and uses spaCy and NLTK to re-rank the unified results without extracting and indexing anything! Includes zero-code configs for Apache Solr, ChatGPT, Elastic Search, OpenSearch, PostgreSQL, Google BigQuery, RequestsGet, Google PSE, NLResearch.com, Miro & more! SWIRL adapts and distributes queries to anything with a search API - search engines, databases, noSQL engines, cloud/SaaS services etc - and uses AI (Large Language Models) to re-rank...

Your PC says CPU 87%. PC Workman says why, since when, and what to do about it. Real-time system monitor with built-in offline AI. No cloud. Your data stays on your machine. What's inside: -hck_GPT: 82-intent AI assistant. -Ask it anything about your PC in Polish or English. -9-layer routing, learns your usage patterns over weeks. -TURBO mode: one click stops unnecessary services (Gaming/Work/Economy profiles), switches power plan, flushes RAM, freezes idle apps. -One click restores...

...Local-first verification, safety monitoring, and guardrails for any LLM 100% Local | No Telemetry | Privacy-First | 500 free calls/day Links Product Page: subodhkc.com/products/llmverify npm: npmjs.com/package/llmverify GitHub: github.com/subodhkc/llmverify-npm Python Package (PyPI): github.com/subodhkc/llmverify Author: Subodh KC — AI governance, compliance, and security leader Feature One-liner What it catches Verify output await verify(aiResponse) Hallucinations, harmful content, quality issues Block injections isInputSafe(userMessage) Prompt injection, jailbreaks, malicious input Redact PII redactPII(text) Emails, phones, SSNs, credit cards, API keys Fix broken JSON repairJSON(broken) Missing brackets, trailing commas, unquoted keys Monitor health monitorLLM(client) Latency spikes, token drift, behavioral changes Sentinel tests sentinel.quick(client, model) LLM regressions b