Port of OpenAI's Whisper model in C/C++
Port of Facebook's LLaMA model in C/C++
User-friendly AI Interface
Run Local LLMs on Any Device. Open-source
ONNX Runtime: cross-platform, high performance ML inferencing
Run frontier MoE models on hardware you already own
High-performance neural network inference framework for mobile
A high-throughput and memory-efficient inference and serving engine
OpenVINO™ Toolkit repository
The free, Open Source alternative to OpenAI, Claude and others
Open standard for machine learning interoperability
Protect and discover secrets using Gitleaks
An Open-Source Programming Framework for Agentic AI
Everything you need to build state-of-the-art foundation models
C++ library for high performance inference on NVIDIA GPUs
A scalable inference server for models optimized with OpenVINO
Replace OpenAI GPT with another LLM in your app
Gaussian processes in TensorFlow
Simplifies the local serving of AI models from any source
Open-Source AI Camera. Empower any camera/CCTV
Integrate, train and manage any AI models and APIs with your database
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Multilingual Automatic Speech Recognition with word-level timestamps
lightweight, standalone C++ inference engine for Google's Gemma models
Fast inference engine for Transformer models