Structured outputs for llms
A high-throughput and memory-efficient inference and serving engine
⚡ Building applications with LLMs through composability ⚡
Open-source end-to-end LLM Development Platform
Open source libraries and APIs to build custom preprocessing pipelines
PandasAI is a Python library that integrates generative AI
Building applications with LLMs through composability
Replace OpenAI GPT with another LLM in your app
Access large language models from the command-line
Label, clean and enrich text datasets with LLMs
LLM abstractions that aren't obstructions
Python bindings for the Transformer models implemented in C/C++
PyTorch library of curated Transformer models and their components
Scalable data pre processing and curation toolkit for LLMs
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Implementation of model parallel autoregressive transformers on GPUs
Keras implement of transformers for humans
An implementation of model parallel GPT-2 and GPT-3-style models