Structured outputs for llms
Python bindings for llama.cpp
Build AI WhatsApp Bots with Pure Python
Run Local LLMs on Any Device. Open-source
Advanced LLM-powered brute-force tool combining AI intelligence
A high-throughput and memory-efficient inference and serving engine
Compress tool outputs, logs, files, and RAG chunks
Fully automatic censorship removal for language models
AirLLM 70B inference with single 4GB GPU
Uncertainty Quantification for Language Models, is a Python package
LLM inference server with continuous batching & SSD caching
PandasAI is a Python library that integrates generative AI
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Access large language models from the command-line
Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon
Open-source AI hackers to find and fix your app’s vulnerabilities
Play ChatGPT and other LLM with Xiaomi AI Speaker
NBA sports betting using machine learning
Language-model investigation agent with a terminal UI
A modular graph-based Retrieval-Augmented Generation (RAG) system
Interact with your documents using the power of GPT
lightweight package to simplify LLM API calls
LLM based data scientist, AI native data application
Simple, Pythonic building blocks to evaluate LLM applications
Operating LLMs in production