Clean and efficient FP8 GEMM kernels with fine-grained scaling
TokenSpeed is a speed-of-light LLM inference engine
Alibaba's high-performance LLM inference engine for diverse apps
A high-performance image compression microservice based on MCP
An Easy-to-use, Scalable and High-performance RLHF Framework
The modern, next-generation Minecraft server proxy
Any model. Any hardware. Zero compromise
High-performance code intelligence MCP server
Run serverless GPU workloads with fast cold starts on bare-metal
High-Quality Voice Cloning TTS for 600+ Languages
A drop-in Apache Spark replacement written in Rust
A @ClickHouse fork that supports high-performance vector search
High-performance inference server for text embeddings models API layer
A mcp server for vikingdb store and search
The fastest way to build data pipelines
High-performance library for gradient boosting on decision trees
Instant, Concurrent, Secure & Lightweight Sandbox for AI Agents
Running a big model on a small laptop
TEN, a voice agent framework to create conversational AI.
RL implementations
NestJS Helper + AI Chatbot Development
High-performance Inference and Deployment Toolkit for LLMs and VLMs
Project-scoped Lean workflow orchestrator from Math, Inc.
High-performance API combining reasoning and creative AI models
A simple, performant and scalable Jax LLM