Structured outputs for llms
Python bindings for llama.cpp
Build AI WhatsApp Bots with Pure Python
Run Local LLMs on Any Device. Open-source
Compress tool outputs, logs, files, and RAG chunks
Advanced LLM-powered brute-force tool combining AI intelligence
Fully automatic censorship removal for language models
A high-throughput and memory-efficient inference and serving engine
Uncertainty Quantification for Language Models, is a Python package
AirLLM 70B inference with single 4GB GPU
Play ChatGPT and other LLM with Xiaomi AI Speaker
PandasAI is a Python library that integrates generative AI
Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon
Open-source AI hackers to find and fix your app’s vulnerabilities
LLM inference server with continuous batching & SSD caching
Access large language models from the command-line
NBA sports betting using machine learning
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Synthetic data curation for post-training and data extraction
Operating LLMs in production
Language-model investigation agent with a terminal UI
AI-Powered Data Processing: Use LOTUS to process all of your datasets
A modular graph-based Retrieval-Augmented Generation (RAG) system
Interact with your documents using the power of GPT
Powerful AI language model (MoE) optimized for efficiency/performance