Search Results for "language"

Call all LLM APIs using the OpenAI format [Anthropic, Huggingface, Cohere, Azure OpenAI etc.] liteLLM supports streaming the model response back, pass stream=True to get a streaming iterator in response. Streaming is supported for OpenAI, Azure, Anthropic, and Huggingface models.

...This server exposes Kong Konnect’s APIs through standardized MCP interfaces so that tools like conversational AI or agent systems can query analytics, inspect configuration, and manage Kong Gateway resources using natural language or programmable agents. By bridging MCP clients to Kong’s control plane, the project allows autonomous agents to retrieve data on traffic metrics, route definitions, services, plugins, and consumer settings without writing custom API integration code. It also groups tools into categories—such as analytics, configuration, and control plane management—to organize capabilities logically for AI workflows.

...By integrating with Envoy and advanced data planes, it handles modern ingress concerns such as traffic routing, authentication, authorization, rate limiting, and observability for traditional HTTP/gRPC services and AI workloads alike. Beyond standard API traffic, kgateway also supports gateway patterns tailored for large language model (LLM) consumption, inference routing, and Model Context Protocol (MCP) orchestration, enabling secure access to models, tools, and agent interactions.