Search Results for "budgets"

...The plugin can expose models through an OpenAI-compatible local endpoint for use by other software. It includes model availability checks, regional-status handling, configurable reasoning budgets, and local performance measurements. A dashboard tracks tokens, latency, generation speed, success rates, and recent requests while keeping usage statistics on the local machine. Built-in updating supports integrity checks, rollback, and hot reload. The project advertises several no-key model channels, although availability, privacy terms, and access conditions ultimately depend on the upstream providers.