Openai style api for open large language models
Easiest and laziest way for building multi-agent LLMs applications
Low-latency REST API for serving text-embeddings
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Large Language Model Text Generation Inference
LLM Chatbot Assistant for Openfire server