Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Structured outputs for llms
Run Local LLMs on Any Device. Open-source
Operating LLMs in production
File Parser optimised for LLM Ingestion with no loss
Building applications with LLMs through composability
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
A Python library powered by Language Models (LLMs)
No-code multi-agent framework to build LLM Agents, workflows
Portia Labs Python SDK for building agentic workflows
Gorilla: An API store for LLMs
⚡ Building applications with LLMs through composability ⚡
Composable building blocks to build Llama Apps
An easy-to-use LLMs quantization package with user-friendly apis
Interact with your documents using the power of GPT
Optimizing inference proxy for LLMs
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Evaluation suite designed to assess the performance of LLMs
Openai style api for open large language models
Integrating LLMs into structured NLP pipelines
Harness LLMs with Multi-Agent Programming
Bench is a tool for evaluating LLMs for production use cases
Composio equip's your AI agents & LLMs
Python framework for AI workflows and pipelines with chain of thought
20+ high-performance LLMs with recipes to pretrain, finetune at scale