Large Language Model Text Generation Inference
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Phi-3.5 for Mac: Locally-run Vision and Language Models
Easiest and laziest way for building multi-agent LLMs applications
Bring the notion of Model-as-a-Service to life
Open platform for training, serving, and evaluating language models
A computer vision framework to create and deploy apps in minutes