Search Results for "microservice"

Cheshire Cat AI Core is an open-source framework for building customizable AI agents as scalable microservices, designed to integrate conversational intelligence into applications through an API-first architecture. It allows developers to create advanced AI assistants that can interact through WebSockets, REST APIs, and embedded chat interfaces, making it suitable for both backend services and user-facing applications. The framework includes built-in support for retrieval-augmented...

llama_deploy is an open-source framework designed to simplify the deployment and productionization of agent-based AI workflows built with the LlamaIndex ecosystem. The project provides an asynchronous architecture that allows developers to deploy complex multi-agent workflows as scalable microservices. It enables teams to move from experimental prototypes to production systems with minimal changes to existing LlamaIndex code, making it easier to operationalize AI agents. The system supports...

Atropos is a comprehensive open-source framework for reinforcement learning (RL) environments tailored specifically to work with large language models (LLMs). Designed as a scalable ecosystem of environment microservices, Atropos allows researchers and developers to collect, evaluate, and manage trajectories (sequences of actions and outcomes) generated by LLMs across a variety of tasks—from static dataset benchmarks to dynamic interactive games and real-world scenario environments. It...

...It advertises large concurrency gains, lower memory use, much faster startup, and dramatically smaller packages while remaining compatible from Java 8 through Java 24. The framework focuses on restrained APIs and an open ecosystem, with modules that cover web, data, cloud, and microservice patterns. Its messaging emphasizes “replaceable Spring” ergonomics—keeping developer familiarity while reducing overhead and improving deployment characteristics. Releases and companion repositories present an active community and production-oriented guidance. The broader Solon org also maintains AI/agent extensions (e.g., MCP components) that complement application development.

...It supports running multiple tools and makes them discoverable to clients that expect Swagger/JSON schemas. In practice, mcpo shortens the path from a local MCP tool to a shareable, network-accessible microservice.