Multilingual Automatic Speech Recognition with word-level timestamps
Build Production-ready Agentic Workflow with Natural Language
Sparsity-aware deep learning inference runtime for CPUs
OpenVINO™ Toolkit repository
Neural Network Compression Framework for enhanced OpenVINO
LLM.swift is a simple and readable library
Large Language Model Text Generation Inference
Standardized Serverless ML Inference Platform on Kubernetes
Efficient few-shot learning with Sentence Transformers
Unified Model Serving Framework
Libraries for applying sparsification recipes to neural networks
A GPU-accelerated library containing highly optimized building blocks
Bring the notion of Model-as-a-Service to life
Data manipulation and transformation for audio signal processing
A Unified Library for Parameter-Efficient Learning
The free, Open Source alternative to OpenAI, Claude and others
Lightweight Python library for adding real-time multi-object tracking
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Integrate, train and manage any AI models and APIs with your database
A toolkit to optimize ML models for deployment for Keras & TensorFlow
Library for serving Transformers models on Amazon SageMaker
A unified framework for scalable computing
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Bolt is a deep learning library with high performance
A real time inference engine for temporal logical specifications