AICI: Prompts as (Wasm) Programs
Port of Facebook's LLaMA model in C/C++
Port of OpenAI's Whisper model in C/C++
Run Local LLMs on Any Device. Open-source
OpenVINO™ Toolkit repository
A high-throughput and memory-efficient inference and serving engine
ONNX Runtime: cross-platform, high performance ML inferencing
C++ library for high performance inference on NVIDIA GPUs
High-performance neural network inference framework for mobile
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Ready-to-use OCR with 80+ supported languages
Everything you need to build state-of-the-art foundation models
Library for OCR-related tasks powered by Deep Learning
The free, Open Source alternative to OpenAI, Claude and others
User-friendly AI Interface
Open standard for machine learning interoperability
Uncover insights, surface problems, monitor, and fine tune your LLM
Unofficial (Golang) Go bindings for the Hugging Face Inference API
The official Python client for the Huggingface Hub
An Open-Source Programming Framework for Agentic AI
Open-Source AI Camera. Empower any camera/CCTV
Phi-3.5 for Mac: Locally-run Vision and Language Models
A RWKV management and startup tool, full automation, only 8MB
PArallel Distributed Deep LEarning: Machine Learning Framework
Deep Learning API and Server in C++14 support for Caffe, PyTorch