On-device AI across mobile, embedded and edge for PyTorch
OpenVINO™ Toolkit repository
Open-Source AI Camera. Empower any camera/CCTV
A toolkit to optimize ML models for deployment for Keras & TensorFlow
Replace OpenAI GPT with another LLM in your app
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
Sparsity-aware deep learning inference runtime for CPUs
MNN is a blazing fast, lightweight deep learning framework
A scalable inference server for models optimized with OpenVINO
A Pythonic framework to simplify AI service building
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Tensor search for humans
A unified framework for scalable computing
Standardized Serverless ML Inference Platform on Kubernetes
AIMET is a library that provides advanced quantization and compression
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Images to inference with no labeling
Open platform for training, serving, and evaluating language models
A computer vision framework to create and deploy apps in minutes