The GPU-powered AI application database
Distributed LLM and StableDiffusion inference
CodeGeeX4-ALL-9B, a versatile model for all AI software development
A drop-in Apache Spark replacement written in Rust
Secure local-first microVM sandbox for running untrusted code fast
Arch is an intelligent prompt gateway. Engineered with (fast) LLMs
Open source IDE for orchestrating AI coding agents in large codebases
A tool to snap pixels to a perfect grid
An improved implementation of the Ralph Wiggum technique
Rust framework for building modular and scalable LLM-powered apps
Cloud-native open source data warehouse for analytics and AI queries
Local AI coding agent CLI with multi-agent orchestration tools
Graph-vector database for building unified AI backends fast
Visual AI IDE for building agents with prompt chains and graphs
Framework to prove inference of ML models blazingly fast
High-performance inference server for text embeddings models API layer
Package and deploy machine learning models using Docker containers
Fast ML inference & training for ONNX models in Rust
Serialize repositories into LLM-ready context w/ smart prioritization
High-performance API combining reasoning and creative AI models
Convert codebases into structured prompts optimized for LLM analysis
Rust async runtime based on io-uring
Deep learning at the speed of light
A small clipboard reader
Shinkai allows you to create advanced AI (local) agents effortlessly