SDG is a specialized framework
Accessible large language models via k-bit quantization for PyTorch
Low-latency REST API for serving text-embeddings
Maimaibot, a (more focused) multi-platform intelligent agent
⚡ Building applications with LLMs through composability ⚡
A Next-Generation Training Engine Built for Ultra-Large MoE Models
TokenSpeed is a speed-of-light LLM inference engine
The first AI agent that builds permissionless integrations
950 line, minimal, extensible LLM inference engine built from scratch
Practical productivity tools for Claude Code, Codex-CLI
A course of learning LLM inference serving on Apple Silicon
SimpleMem: Efficient Lifelong Memory for LLM Agents
AI Agent Evaluator & Red Team Platform
SQL-Driven RAG Engine
AI Powered Knowledge Graph Generator
Neural Network architecture based on ideas of the original LSTM
A lightweight framework for building LLM-based agents
CV, NLP, LLM project applications, and advanced engineering deployment
Multimodal Agents as Smartphone Users, an LLM-based multimodal agent
Train a 26M-parameter GPT from scratch in just 2h
Research-oriented chatbot framework
File Parser optimised for LLM Ingestion with no loss
Framework to easily create LLM powered bots over any dataset
Streamlines and simplifies prompt design for both developers
Power CLI and Workflow manager for LLMs (core package)