SGLang is a fast serving framework for large language models
Python library for defining and optimizing mathematical expressions
Practice implementing softmax, attention, GPT-2 and more
Simulation of spiking neural networks (SNNs) using PyTorch
Ongoing research training transformer models at scale
Relax! Flux is the ML library that doesn't make you tensor
A bidirectional pipeline parallelism algorithm
A course of learning LLM inference serving on Apple Silicon
Python package built to ease deep learning on graph
CV, NLP, LLM project applications, and advanced engineering deployment
Open deep learning compiler stack for cpu, gpu, etc.
AIMET is a library that provides advanced quantization and compression
Prevent PyTorch's `CUDA error: out of memory` in just 1 line of code
A high-level machine learning and deep learning library for PHP
LiteRT, successor to TensorFlow Lite
Deep learning optimization library: makes distributed training easy
MII makes low-latency and high-throughput inference possible
Large-language-model & vision-language-model based on Linear Attention
Tensors and neural networks in Haskell
Tools to process and visualize scientific data and images
High-level training, data augmentation, and utilities for Pytorch
Deep and online learning with spiking neural networks in Python
Deep learning in Rust, with shape checked tensors and neural networks
llama.go is like llama.cpp in pure Golang
An ecosystem of Rust libraries for working with large language models