AIMET is a library that provides advanced quantization and compression
Superduper: Integrate AI models and machine learning workflows
Open platform for training, serving, and evaluating language models
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
Integrate, train and manage any AI models and APIs with your database
Database system for building simpler and faster AI-powered application
Serve machine learning models within a Docker container
LLMFlows - Simple, Explicit and Transparent LLM Apps
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere
OpenFieldAI is an AI based Open Field Test Rodent Tracker
A computer vision framework to create and deploy apps in minutes
Framework for Accelerating LLM Generation with Multiple Decoding Heads
Run 100B+ language models at home, BitTorrent-style
A graphical manager for ollama that can manage your LLMs
Toolbox of models, callbacks, and datasets for AI/ML researchers
Implementation of "Tree of Thoughts
Implementation of model parallel autoregressive transformers on GPUs
Lightweight anchor-free object detection model
Sequence-to-sequence framework, focused on Neural Machine Translation
OpenMMLab Video Perception Toolbox
Training & Implementation of chatbots leveraging GPT-like architecture
Toolkit for allowing inference and serving with MXNet in SageMaker
CPU/GPU inference server for Hugging Face transformer models
Deploy a ML inference service on a budget in 10 lines of code