Structured outputs for llms
A high-throughput and memory-efficient inference and serving engine
⚡ Building applications with LLMs through composability ⚡
Open-source end-to-end LLM Development Platform
Open source libraries and APIs to build custom preprocessing pipelines
Building applications with LLMs through composability
PandasAI is a Python library that integrates generative AI
Access large language models from the command-line
Label, clean and enrich text datasets with LLMs
LLM abstractions that aren't obstructions
Python bindings for the Transformer models implemented in C/C++
PyTorch library of curated Transformer models and their components
Scalable data pre processing and curation toolkit for LLMs
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Replace OpenAI GPT with another LLM in your app
Implementation of model parallel autoregressive transformers on GPUs
Keras implement of transformers for humans
An implementation of model parallel GPT-2 and GPT-3-style models