Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
A high-throughput and memory-efficient inference and serving engine
The official Python client for the Huggingface Hub
Single-cell analysis in Python
FlashInfer: Kernel Library for LLM Serving
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Operating LLMs in production
Uplift modeling and causal inference with machine learning algorithms
DoWhy is a Python library for causal inference
Everything you need to build state-of-the-art foundation models
A unified framework for scalable computing
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
AIMET is a library that provides advanced quantization and compression
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Optimizing inference proxy for LLMs
Large Language Model Text Generation Inference
MII makes low-latency and high-throughput inference possible
Gaussian processes in TensorFlow
Uncover insights, surface problems, monitor, and fine tune your LLM
A Pythonic framework to simplify AI service building
A library for accelerating Transformer models on NVIDIA GPUs
20+ high-performance LLMs with recipes to pretrain, finetune at scale
Easiest and laziest way for building multi-agent LLMs applications