Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
A high-throughput and memory-efficient inference and serving engine
Everything you need to build state-of-the-art foundation models
MII makes low-latency and high-throughput inference possible
Standardized Serverless ML Inference Platform on Kubernetes
Create HTML profiling reports from pandas DataFrame objects
Operating LLMs in production
Easiest and laziest way for building multi-agent LLMs applications
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Framework that is dedicated to making neural data processing
OpenMMLab Model Deployment Framework
Fast inference engine for Transformer models
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Optimizing inference proxy for LLMs
Database system for building simpler and faster AI-powered application
Trainable models and NN optimization tools
State-of-the-art diffusion models for image and audio generation
AIMET is a library that provides advanced quantization and compression
Open-Source AI Camera. Empower any camera/CCTV
Uplift modeling and causal inference with machine learning algorithms
A Pythonic framework to simplify AI service building
Official inference library for Mistral models