User-friendly AI Interface
Openai style api for open large language models
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Build Production-ready Agentic Workflow with Natural Language
Port of OpenAI's Whisper model in C/C++
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
Everything you need to build state-of-the-art foundation models
ONNX Runtime: cross-platform, high performance ML inferencing
High-performance neural network inference framework for mobile
OpenVINO™ Toolkit repository
The free, Open Source alternative to OpenAI, Claude and others
Protect and discover secrets using Gitleaks
Training and deploying machine learning models on Amazon SageMaker
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
The official Python client for the Huggingface Hub
Uncover insights, surface problems, monitor, and fine tune your LLM
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Gaussian processes in TensorFlow
LLM.swift is a simple and readable library
Operating LLMs in production
Bring the notion of Model-as-a-Service to life
A RWKV management and startup tool, full automation, only 8MB
Open-Source AI Camera. Empower any camera/CCTV
Run serverless GPU workloads with fast cold starts on bare-metal