Python bindings for llama.cpp
Structured outputs for llms
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Powerful AI language model (MoE) optimized for efficiency/performance
Open-source, high-performance AI model with advanced reasoning
A high-throughput and memory-efficient inference and serving engine
Low-code app builder for RAG and multi-agent AI applications
Revolutionizing Database Interactions with Private LLM Technology
A guidance language for controlling large language models
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
⚡ Building applications with LLMs through composability ⚡
Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon
Adding guardrails to large language models
Operating LLMs in production
Building applications with LLMs through composability
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
Framework and no-code GUI for fine-tuning LLMs
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Open-source observability for your LLM application
Open source libraries and APIs to build custom preprocessing pipelines
Multilingual sentence & image embeddings with BERT
BISHENG is an open LLM devops platform for next generation apps
Integrate cutting-edge LLM technology quickly and easily into your app