Run Local LLMs on Any Device. Open-source
Easiest and laziest way for building multi-agent LLMs applications
Low-latency REST API for serving text-embeddings
Large Language Model Text Generation Inference
A library for accelerating Transformer models on NVIDIA GPUs
Optimizing inference proxy for LLMs
The Triton Inference Server provides an optimized cloud
Replace OpenAI GPT with another LLM in your app
Bring the notion of Model-as-a-Service to life
A high-performance ML model serving framework, offers dynamic batching
Operating LLMs in production
Data manipulation and transformation for audio signal processing
Simplifies the local serving of AI models from any source
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Unified Model Serving Framework
Library for OCR-related tasks powered by Deep Learning
Openai style api for open large language models
The unofficial python package that returns response of Google Bard
Framework that is dedicated to making neural data processing
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere
Run 100B+ language models at home, BitTorrent-style
Implementation of "Tree of Thoughts