AICI: Prompts as (Wasm) Programs
High-performance neural network inference framework for mobile
Port of Facebook's LLaMA model in C/C++
Easy-to-use deep learning framework with 3 key features
Port of OpenAI's Whisper model in C/C++
A high-throughput and memory-efficient inference and serving engine
OpenVINO™ Toolkit repository
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
A general-purpose probabilistic programming system
Run Local LLMs on Any Device. Open-source
PArallel Distributed Deep LEarning: Machine Learning Framework
The official Python client for the Huggingface Hub
Unofficial (Golang) Go bindings for the Hugging Face Inference API
A unified framework for scalable computing
Self-hosted, community-driven, local OpenAI compatible API
Visual Instruction Tuning: Large Language-and-Vision Assistant
An Open-Source Programming Framework for Agentic AI
ONNX Runtime: cross-platform, high performance ML inferencing
Gaussian processes in TensorFlow
LLMs and Machine Learning done easily
Build Production-ready Agentic Workflow with Natural Language
Bayesian inference with probabilistic programming
Phi-3.5 for Mac: Locally-run Vision and Language Models
Openai style api for open large language models
Deep Learning API and Server in C++14 support for Caffe, PyTorch