User-friendly AI Interface
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Run Local LLMs on Any Device. Open-source
OpenMLDB is an open-source machine learning database
Unified Model Serving Framework
A high-performance ML model serving framework, offers dynamic batching