Ready-to-use OCR with 80+ supported languages
Library for OCR-related tasks powered by Deep Learning
AIMET is a library that provides advanced quantization and compression
MII makes low-latency and high-throughput inference possible
Deep learning optimization library: makes distributed training easy
DoWhy is a Python library for causal inference
Superduper: Integrate AI models and machine learning workflows
Fast inference engine for Transformer models
A set of Docker images for training and serving models in TensorFlow
Trainable models and NN optimization tools
Operating LLMs in production
The unofficial python package that returns response of Google Bard
Official inference library for Mistral models
Multi-Modal Neural Networks for Semantic Search, based on Mid-Fusion
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Implementation of "Tree of Thoughts
Sequence-to-sequence framework, focused on Neural Machine Translation
Guide to deploying deep-learning inference networks
Toolkit for allowing inference and serving with MXNet in SageMaker