User-friendly AI Interface
Run Local LLMs on Any Device. Open-source
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
OpenMLDB is an open-source machine learning database
A high-performance ML model serving framework, offers dynamic batching
Unified Model Serving Framework