Openai style api for open large language models
Simplifies the local serving of AI models from any source
Low-latency REST API for serving text-embeddings
Port of OpenAI's Whisper model in C/C++
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Unified Model Serving Framework
A high-performance ML model serving framework, offers dynamic batching
The unofficial python package that returns response of Google Bard