User-friendly AI Interface
Openai style api for open large language models
Port of OpenAI's Whisper model in C/C++
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
ONNX Runtime: cross-platform, high performance ML inferencing
High-performance neural network inference framework for mobile
Ready-to-use OCR with 80+ supported languages
The free, Open Source alternative to OpenAI, Claude and others
Everything you need to build state-of-the-art foundation models
OpenVINO™ Toolkit repository
Open standard for machine learning interoperability
Uncover insights, surface problems, monitor, and fine tune your LLM
A high-throughput and memory-efficient inference and serving engine
C++ library for high performance inference on NVIDIA GPUs
Protect and discover secrets using Gitleaks
An Open-Source Programming Framework for Agentic AI
Open-Source AI Camera. Empower any camera/CCTV
Run serverless GPU workloads with fast cold starts on bare-metal
GPU environment management and cluster orchestration
Library for OCR-related tasks powered by Deep Learning
The Triton Inference Server provides an optimized cloud
State-of-the-art diffusion models for image and audio generation
Connect home devices into a powerful cluster to accelerate LLM
A scalable inference server for models optimized with OpenVINO