Python bindings for llama.cpp
Structured outputs for llms
Run Local LLMs on Any Device. Open-source
Powerful AI language model (MoE) optimized for efficiency/performance
Open-source, high-performance AI model with advanced reasoning
A high-throughput and memory-efficient inference and serving engine
Revolutionizing Database Interactions with Private LLM Technology
A guidance language for controlling large language models
Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon
⚡ Building applications with LLMs through composability ⚡
Adding guardrails to large language models
Operating LLMs in production
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
Framework and no-code GUI for fine-tuning LLMs
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Open-source observability for your LLM application
Open source libraries and APIs to build custom preprocessing pipelines
Multilingual sentence & image embeddings with BERT
BISHENG is an open LLM devops platform for next generation apps
A modular graph-based Retrieval-Augmented Generation (RAG) system
Database system for building simpler and faster AI-powered application
PyTorch library of curated Transformer models and their components
MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training
Toolkit for conversational AI
An AI personal assistant for your digital brain