Structured outputs for llms
Accelerate local LLM inference and finetuning
PandasAI is a Python library that integrates generative AI
Gemma open-weight LLM library, from Google DeepMind
Scalable data pre processing and curation toolkit for LLMs
Uncertainty Quantification for Language Models, is a Python package
A python module to repair invalid JSON from LLMs
Synthetic data curation for post-training and data extraction
A high-throughput and memory-efficient inference and serving engine
AirLLM 70B inference with single 4GB GPU
Access large language models from the command-line
Accessible large language models via k-bit quantization for PyTorch
LLM abstractions that aren't obstructions
Open source libraries and APIs to build custom preprocessing pipelines
Tools for merging pretrained large language models
Easy token price estimates for 400+ LLMs. TokenOps
The Security Toolkit for LLM Interactions
Replace OpenAI GPT with another LLM in your app
DepGraph: Towards Any Structural Pruning
NeurIPS2025 Spotlight] Quantized Attention
Schema-Guided Reasoning (SGR) has agentic system design
⚡ Building applications with LLMs through composability ⚡
A simple, performant and scalable Jax LLM
A New Axis of Sparsity for Large Language Models
Advanced techniques for RAG systems