Structured outputs for llms
Accelerate local LLM inference and finetuning
PandasAI is a Python library that integrates generative AI
Uncertainty Quantification for Language Models, is a Python package
Gemma open-weight LLM library, from Google DeepMind
Scalable data pre processing and curation toolkit for LLMs
A python module to repair invalid JSON from LLMs
Synthetic data curation for post-training and data extraction
A high-throughput and memory-efficient inference and serving engine
AirLLM 70B inference with single 4GB GPU
Access large language models from the command-line
Open source libraries and APIs to build custom preprocessing pipelines
Accessible large language models via k-bit quantization for PyTorch
LLM abstractions that aren't obstructions
Building applications with LLMs through composability
Easy token price estimates for 400+ LLMs. TokenOps
Tools for merging pretrained large language models
Replace OpenAI GPT with another LLM in your app
DepGraph: Towards Any Structural Pruning
The Security Toolkit for LLM Interactions
NeurIPS2025 Spotlight] Quantized Attention
Schema-Guided Reasoning (SGR) has agentic system design
⚡ Building applications with LLMs through composability ⚡
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
A simple, performant and scalable Jax LLM