Python bindings for llama.cpp
Structured outputs for llms
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Open-source, high-performance AI model with advanced reasoning
Powerful AI language model (MoE) optimized for efficiency/performance
A high-throughput and memory-efficient inference and serving engine
Phi-3.5 for Mac: Locally-run Vision and Language Models
Low-code app builder for RAG and multi-agent AI applications
Framework and no-code GUI for fine-tuning LLMs
Revolutionizing Database Interactions with Private LLM Technology
⚡ Building applications with LLMs through composability ⚡
MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training
Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon
A guidance language for controlling large language models
Adding guardrails to large language models
PyTorch library of curated Transformer models and their components
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
Operating LLMs in production
Integrate cutting-edge LLM technology quickly and easily into your app
Toolkit for conversational AI
An AI personal assistant for your digital brain
Database system for building simpler and faster AI-powered application