Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Structured outputs for llms
Ollama Python library
Run Local LLMs on Any Device. Open-source
Operating LLMs in production
File Parser optimised for LLM Ingestion with no loss
Building applications with LLMs through composability
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
A Python library powered by Language Models (LLMs)
No-code multi-agent framework to build LLM Agents, workflows
Portia Labs Python SDK for building agentic workflows
ID-based RAG FastAPI: Integration with Langchain and PostgreSQL
Gorilla: An API store for LLMs
⚡ Building applications with LLMs through composability ⚡
Composable building blocks to build Llama Apps
An easy-to-use LLMs quantization package with user-friendly apis
Prompt Declaration Language is a declarative prompt programming lang
Interact with your documents using the power of GPT
Optimizing inference proxy for LLMs
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Evaluation suite designed to assess the performance of LLMs
Openai style api for open large language models
Integrating LLMs into structured NLP pipelines
Bench is a tool for evaluating LLMs for production use cases
Harness LLMs with Multi-Agent Programming