LightLLM is a Python-based LLM (Large Language Model) inference
A lightweight vLLM implementation built from scratch
Inference Llama 2 in one file of pure C
Simple, Pythonic building blocks to evaluate LLM applications
Swirl queries any number of data sources with APIs
A modular graph-based Retrieval-Augmented Generation (RAG) system
Multi-Agents LLM Financial Trading Framework
Phi-3.5 for Mac: Locally-run Vision and Language Models
File Parser optimised for LLM Ingestion with no loss
Build a modern LLM from scratch. Every line commented
AI-Powered Data Processing: Use LOTUS to process all of your datasets
Using AI models to automatically provide commentary and edit videos
SimpleMem: Efficient Lifelong Memory for LLM Agents
Inference code for CodeLlama models
An elegent pytorch implement of transformers
Claude + Obsidian knowledge companion
Big Model Application Development Practice 1
Adding guardrails to large language models
Framework and no-code GUI for fine-tuning LLMs
An AI-powered file management tool that ensures privacy
A course of learning LLM inference serving on Apple Silicon
Replace OpenAI GPT with another LLM in your app
Official Repo for ICML 2024 paper
LLM based data scientist, AI native data application
Tools like web browser, computer access and code runner for LLMs