A course of learning LLM inference serving on Apple Silicon
Schema-Guided Reasoning (SGR) has agentic system design
Here comes a selection of technology stacks and tool repositories
TT-NN operator library, and TT-Metalium low level kernel programming
Port of Facebook's LLaMA model in C/C++
Official code repo for the O'Reilly Book
Run Local LLMs on Any Device. Open-source
Fast and efficient unstructured data extraction
Fully automatic censorship removal for language models
The PHP Agentic Framework to build production-ready AI driven apps
A lightweight vLLM implementation built from scratch
950 line, minimal, extensible LLM inference engine built from scratch
Fast Multimodal LLM on Mobile Devices
Cloud-native runtime for agentic AI
Your Personal Research Multi-Tool
Datawhale members have compiled a book covering machine learning
Power CLI and Workflow manager for LLMs (core package)
CV, NLP, LLM project applications, and advanced engineering deployment
Convert any URL to an LLM-friendly input with a simple prefix
Refer and Ground Anything Anywhere at Any Granularity
AI-Powered Data Processing: Use LOTUS to process all of your datasets
Open-source large language model family from Tencent Hunyuan
Large-language-model & vision-language-model based on Linear Attention
A @ClickHouse fork that supports high-performance vector search
Alibaba's high-performance LLM inference engine for diverse apps