OpenVINO™ Toolkit repository
Simplifies the local serving of AI models from any source
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Replace OpenAI GPT with another LLM in your app
Sequence-to-sequence framework, focused on Neural Machine Translation
Guide to deploying deep-learning inference networks
Deploy a ML inference service on a budget in 10 lines of code