AICI: Prompts as (Wasm) Programs
Port of Facebook's LLaMA model in C/C++
Port of OpenAI's Whisper model in C/C++
Run Local LLMs on Any Device. Open-source
OpenVINO™ Toolkit repository
ONNX Runtime: cross-platform, high performance ML inferencing
A high-throughput and memory-efficient inference and serving engine
C++ library for high performance inference on NVIDIA GPUs
High-performance neural network inference framework for mobile
Ready-to-use OCR with 80+ supported languages
Everything you need to build state-of-the-art foundation models
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
User-friendly AI Interface
The free, Open Source alternative to OpenAI, Claude and others
Library for OCR-related tasks powered by Deep Learning
Open standard for machine learning interoperability
Uncover insights, surface problems, monitor, and fine tune your LLM
Open-Source AI Camera. Empower any camera/CCTV
Unofficial (Golang) Go bindings for the Hugging Face Inference API
The official Python client for the Huggingface Hub
An Open-Source Programming Framework for Agentic AI
A RWKV management and startup tool, full automation, only 8MB
Phi-3.5 for Mac: Locally-run Vision and Language Models
PArallel Distributed Deep LEarning: Machine Learning Framework
Deep Learning API and Server in C++14 support for Caffe, PyTorch