Python bindings for llama.cpp
The Classical Language Toolkit
Structured outputs for llms
High-level, high-performance dynamic language for technical computing
Access large language models from the command-line
NLP Cloud serves high performance pre-trained or custom models for NER
Run Local LLMs on Any Device. Open-source
A Python library powered by Language Models (LLMs)
A guidance language for controlling large language models
DSPy: The framework for programming—not prompting—language models
Port of Facebook's LLaMA model in C/C++
An LLM-powered knowledge curation system that researches topics
PandasAI is a Python library that integrates generative AI
Efficient Triton Kernels for LLM Training
TextWorld is a sandbox learning environment for the training
The most accurate natural language detection library for Python
An easy-to-use LLMs quantization package with user-friendly apis
Operating LLMs in production
A high-throughput and memory-efficient inference and serving engine
Tools like web browser, computer access and code runner for LLMs
Stanford NLP Python library for many human languages
A Model Context Protocol (MCP) server
Ongoing research training transformer models at scale
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Robust Speech Recognition via Large-Scale Weak Supervision