User-friendly AI Interface
Openai style api for open large language models
Everything you need to build state-of-the-art foundation models
Open standard for machine learning interoperability
Run serverless GPU workloads with fast cold starts on bare-metal
A toolkit to optimize ML models for deployment for Keras & TensorFlow
C++ library for high performance inference on NVIDIA GPUs
Port of OpenAI's Whisper model in C/C++
Framework which allows you transform your Vector Database
Port of Facebook's LLaMA model in C/C++
Uncover insights, surface problems, monitor, and fine tune your LLM
Build Production-ready Agentic Workflow with Natural Language
Probabilistic reasoning and statistical analysis in TensorFlow
Run Local LLMs on Any Device. Open-source
A GPU-accelerated library containing highly optimized building blocks
AI interface for tinkerers (Ollama, Haystack RAG, Python)
Set of comprehensive computer vision & machine intelligence libraries
MNN is a blazing fast, lightweight deep learning framework
Adversarial Robustness Toolbox (ART) - Python Library for ML security
A scalable inference server for models optimized with OpenVINO
Trainable models and NN optimization tools
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT method
Serving system for machine learning models
Deep Learning API and Server in C++14 support for Caffe, PyTorch
The free, Open Source alternative to OpenAI, Claude and others