Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
A high-throughput and memory-efficient inference and serving engine
The official Python client for the Huggingface Hub
Ready-to-use OCR with 80+ supported languages
Single-cell analysis in Python
Everything you need to build state-of-the-art foundation models
A Pythonic framework to simplify AI service building
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Gaussian processes in TensorFlow
Official inference library for Mistral models
Easiest and laziest way for building multi-agent LLMs applications
Operating LLMs in production
DoWhy is a Python library for causal inference
Unified Model Serving Framework
Adversarial Robustness Toolbox (ART) - Python Library for ML security
Bring the notion of Model-as-a-Service to life
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
The unofficial python package that returns response of Google Bard
The Triton Inference Server provides an optimized cloud
State-of-the-art diffusion models for image and audio generation
Uplift modeling and causal inference with machine learning algorithms
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model