Open Source Rust Artificial Intelligence Software - Page 2
Sort By:
Rust Artificial Intelligence Software
View 13782 business solutionsBrowse free open source Rust Artificial Intelligence Software and projects below. Use the toggles on the left to filter open source Rust Artificial Intelligence Software by OS, license, language, programming language, and project status.
-
Go From AI Idea to AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
Earn up to 16% annual interest with Nexo.Generate interest, access liquidity without selling, and execute trades seamlessly. All in one platform. Geographic restrictions, eligibility, and terms apply.
-
1
Edgee
AI gateway with token compression for Claude Code, Codex, and more
Edgee is an edge-native execution platform designed to run AI-driven logic and data processing directly at the network edge, reducing latency and improving responsiveness for modern applications. It enables developers to deploy functions and workflows closer to users, allowing real-time processing without relying heavily on centralized cloud infrastructure. The platform is built to support event-driven architectures, where actions are triggered by incoming requests, user behavior, or external signals. It integrates AI capabilities into edge environments, making it possible to perform inference, personalization, and decision-making at the point of interaction. Edgee is optimized for performance and scalability, leveraging distributed execution to handle high volumes of requests efficiently. It also emphasizes developer experience, providing tools and abstractions that simplify deployment and orchestration across edge nodes. -
2
MusicGPT
Generate music based on natural language prompts using LLMs
MusicGPT is an open-source application designed to generate music from natural language prompts using locally executed artificial intelligence models. The software allows users to run advanced music generation systems directly on their own devices without requiring heavy dependencies such as Python or full machine learning frameworks. Instead, it provides a lightweight environment capable of executing music generation models locally on CPUs or GPUs while maintaining strong performance across operating systems including Windows, macOS, and Linux. Users can describe a musical style, mood, or instrumentation using text prompts, and the system produces original audio samples based on those instructions. The application currently integrates with models such as MusicGen and is designed to support additional models transparently in the future. In addition to a command-line interface, the project includes a web-based interface that enables conversational interaction with the AI model. -
3
Note67
A private, local meeting notes assistant
note67 is a private, local meeting notes assistant application that combines audio capture, transcription, and AI-powered summarization to help users document conversations and meetings on their own devices without relying on cloud services. Built with a cross-platform architecture using Rust (via Tauri) for backend logic and a TypeScript/React frontend, it prioritizes privacy by performing audio transcription locally with Whisper models and generating summaries with locally-hosted AI, eliminating the need to send sensitive meeting content to external servers. Users can record meetings directly from their microphone, view live transcriptions, filter by speaker, and export structured summaries, making it useful for professionals who need searchable, organized records of discussions. It also features thoughtful signal processing such as voice activity detection and echo deduplication to improve transcription accuracy, and provides standard note-taking features. -
4
OpenFang
Open-source Agent Operating System
OpenFang is an open-source agent operating system designed to orchestrate autonomous AI agents and workflows in a structured, production-oriented environment. Written primarily in Rust, the project focuses on building a high-performance runtime where multiple specialized agents can collaborate to complete complex computational or development tasks. It aims to move beyond simple chat-based agents by providing infrastructure for persistent agent memory, task coordination, and scalable execution. The system is positioned as a foundation for building advanced AI tooling, particularly in environments that require tight integration with GPU workflows and modern AI pipelines. OpenFang emphasizes modularity and extensibility so developers can plug in custom agents, tools, or execution backends. Overall, the project represents an emerging class of “agent OS” platforms that treat AI agents as first-class computational actors rather than isolated scripts. -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
OpenShell
OpenShell is the safe, private runtime for autonomous AI agents.
OpenShell is an open-source runtime designed to safely run autonomous AI agents in isolated environments. Developed by NVIDIA, it provides sandboxed execution spaces that protect system resources, credentials, and data from unauthorized access. Each agent runs inside a containerized sandbox governed by declarative YAML security policies that control network access, file permissions, and process behavior. The platform includes a gateway service that manages sandbox lifecycles and routes AI inference requests through controlled providers. OpenShell also features a privacy-aware routing system that prevents sensitive information from leaving the sandbox environment. By combining container isolation, policy enforcement, and agent orchestration, OpenShell offers a secure infrastructure for developing and operating AI agents. -
6
Plano
Delivery infrastructure for agentic apps
Plano is an AI-native proxy and data plane designed to simplify the infrastructure required to deploy and operate agentic applications in production environments. It removes repetitive plumbing work from application code by centralizing capabilities such as agent routing, orchestration, guardrails, observability, and model selection. Built on modern proxy technology and compatible with any language or AI framework, Plano enables developers to focus on core agent logic instead of infrastructure complexity. The system provides intelligent LLM routing APIs that support model agility, along with filter chains for safety, moderation, and memory hooks. It also exposes rich traces, metrics, and logs to support continuous improvement of agent behavior in production. Overall, Plano functions as delivery infrastructure for scalable, maintainable AI agent systems. -
7
Rust Port
The Rust workspace under rust/ is the current systems-language port
Rust Port is an open-source reconstruction and experimentation framework derived from leaked or reverse-engineered versions of advanced AI coding agents, designed to replicate and extend the capabilities of agentic development systems. It functions as a programmable coding assistant that operates through autonomous workflows, enabling users to generate, modify, and analyze code with minimal manual intervention. The project emphasizes agent-based execution, where tasks are broken down into steps and handled iteratively, simulating how modern AI coding tools operate in production environments. It is often used as a sandbox for exploring how large-scale coding agents behave, including their decision-making processes, tool usage, and workflow orchestration. The system likely includes abstractions for handling file systems, executing commands, and maintaining context across sessions, allowing for more persistent and intelligent coding interactions. -
8
shimmy
Python-free Rust inference server
The shimmy project is a lightweight local inference server designed to run large language models with minimal overhead. Written primarily in Rust, the tool provides a small standalone binary that exposes an API compatible with the OpenAI interface, allowing existing applications to interact with local models without significant code changes. This compatibility enables developers to replace remote AI services with locally hosted models while keeping their existing software architecture intact. Shimmy focuses on performance and simplicity, using efficient runtime components to minimize memory usage and startup time compared to heavier inference frameworks. It supports modern model formats such as GGUF and SafeTensors and can automatically discover models stored locally or in common directories used by other AI tools. Advanced capabilities include CPU offloading for Mixture-of-Experts models and GPU acceleration, enabling large models to run on consumer hardware with limited VRAM. -
9
Burn
Burn is a new comprehensive dynamic Deep Learning Framework
Burn is a new comprehensive dynamic Deep Learning Framework from Tracel AI built using Rust with extreme flexibility, compute efficiency and portability as its primary goals. Burn emphasizes performance, flexibility, and portability for both training and inference. Developed in Rust, it is designed to empower machine learning engineers and researchers across industry and academia. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
Crabtalk
Agents daemon that hides nothing
Crabtalk is a composable AI agent runtime designed to provide a minimal yet powerful foundation for building and orchestrating intelligent agents within a single lightweight binary. It is implemented in Rust and focuses on delivering high performance, reliability, and low overhead compared to more complex agent frameworks. The system is built around a small set of core primitives, including skills, memory, context isolation, and extensions, which together enable flexible and modular agent behavior. CrabTalk emphasizes simplicity by avoiding unnecessary abstractions, allowing developers to maintain full control over how agents operate and interact with their environment. One of its key design goals is to address common issues in multi-agent systems, such as context fragmentation and coordination inefficiencies, by providing clearer structure and tighter control over execution. -
11
Databend
Cloud-native open source data warehouse for analytics and AI queries
Databend is an open source cloud-native data warehouse designed for large-scale analytics and modern data workloads. Built in Rust, the system focuses on high performance, scalability, and efficient data processing for analytical queries. It is designed with a separation of compute and storage, allowing compute nodes to scale independently while storing data in object storage systems. This architecture enables cost-efficient storage and elastic scaling for workloads that involve large datasets and complex queries. Databend provides a unified engine capable of handling analytics, vector search, and full-text search within a single platform. Databend supports SQL-based workflows and enables real-time data ingestion, transformation, and analysis through streaming and task orchestration features. With its cloud-native design and distributed architecture, Databend can run both as a self-hosted system or within managed environments to power data analytics, AI workloads, and large-scale data. -
12
Google Workspace CLI
Command-line tool for Drive, Gmail, Calendar, Sheets, Docs, Chat, etc.
Google Workspace CLI (gws) is a command-line tool designed to interact with Google Workspace services such as Drive, Gmail, Calendar, Sheets, and more from a single interface. It dynamically generates its command structure using Google’s Discovery Service, allowing it to automatically support new API endpoints as they become available. The tool eliminates the need for manual REST API calls by providing structured commands and built-in help for each resource and method. It outputs structured JSON responses, making it easy for developers, scripts, and AI agents to process results programmatically. The CLI supports multiple authentication methods, including OAuth login, service accounts, and environment-based credentials for automated environments. With built-in agent skills and automation features, it enables developers and AI systems to manage and automate Google Workspace workflows efficiently. -
13
Korvus
Korvus is a search SDK that unifies the entire RAG pipeline
Korvus is an open-source retrieval-augmented generation (RAG) pipeline designed to run entirely inside PostgreSQL, allowing developers to build AI search and knowledge systems directly within a database environment. The project consolidates the typical steps of a RAG pipeline—including embedding generation, document retrieval, reranking, and text generation—into a single query executed within the Postgres ecosystem. By leveraging PostgresML and vector extensions such as pgvector, Korvus eliminates the need for external microservices typically used for AI search architectures, reducing both system complexity and latency. The architecture enables machine learning operations to occur directly in the database, minimizing data transfer between services and improving overall performance for large datasets. -
14
Moltis
A Rust-native claw you can trust
Moltis is an open-source personal AI assistant platform written in Rust that is designed to run as a fully self-hosted, local-first agent environment. It compiles the entire assistant stack, including the web interface, model routing, memory, and tools, into a single self-contained binary with no external runtime dependencies. The system supports multiple large language model providers alongside local models, enabling users to maintain privacy while still accessing cloud capabilities when needed. Moltis emphasizes security through sandboxed execution environments, where commands and browsing tasks run in isolated containers and require explicit approval. The platform also includes long-term memory powered by hybrid vector and full-text search, allowing the assistant to retain context across sessions. With multi-channel access such as web UI, Telegram, and API endpoints, Moltis functions as a unified automation hub intended for developers and advanced users who want full control. -
15
Monty
A minimal, secure Python interpreter written in Rust for use by AI
Monty is an experimental, security-focused Python interpreter implemented in Rust and intended for running AI-generated Python safely under strict constraints. The project’s core goal is to enable code execution in environments where untrusted or model-produced code must be tightly sandboxed to reduce risk. Rather than offering a full “general-purpose Python runtime with everything enabled,” Monty is designed to be minimal and controlled, making it easier to reason about what code can do and what it cannot. It prioritizes guardrails like resource limits and restricted capabilities, which is especially useful for agentic workflows that need to execute small pieces of Python for data transforms, validation, or tool-like computations. Because it’s written in Rust, it’s positioned to deliver a compact, portable runtime that can be embedded into larger systems that need dependable isolation. -
16
Phantasm
Toolkits to create a human-in-the-loop approval layer
Phantasm offers toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents' workflows in real-time, ensuring safety and reliability in AI operations. -
17
Sail
A drop-in Apache Spark replacement written in Rust
Sail is an open-source distributed computation framework designed to unify batch processing, stream processing, and AI workloads into a single, high-performance engine. It is built entirely in Rust, eliminating JVM overhead and enabling predictable performance, fast startup times, and improved memory safety compared to traditional big data frameworks. Sail is compatible with the Spark Connect protocol, which means existing Spark SQL and DataFrame workloads can run without code changes, making adoption seamless for teams already using Spark-based pipelines. The framework is designed to operate across a variety of environments, including local machines, Kubernetes clusters, and cloud deployments, allowing flexible scaling based on workload requirements. It also emphasizes cost efficiency, with benchmarks showing significant performance improvements and reduced infrastructure usage compared to traditional systems. -
18
Sprite Fusion Pixel Snapper
A tool to snap pixels to a perfect grid
Sprite Fusion Pixel Snapper is a utility designed to eliminate sub-pixel rendering issues that often arise in pixel art, UI icons, and 2D sprite graphics when displayed on screens with high DPI or during motion animations. The tool works by adjusting sprite rendering coordinates and texture sampling so that every pixel aligns cleanly to the screen’s pixel grid, avoiding blurring, distortion, or unintended smoothing artifacts. This is especially important in pixel art games, retro-styled interactive media, or precise UI designs where crisp edges and predictable alignment are essential. SpriteFusion Pixel Snapper integrates with popular game engines and rendering pipelines to ensure that assets remain sharp across a broad range of resolutions and aspect ratios without requiring manual fiddling from artists or developers. It includes options for snapping modes, filtering overrides, and automatic correction detection that can be applied on export or at runtime. -
19
Vibe Kanban
Get 10X more out of Claude Code, Codex or any coding agent
Vibe Kanban is an open-source, self-hosted orchestration and workflow platform designed to help developers manage and coordinate the work of AI coding agents using a visual Kanban-style interface rather than juggling terminals and logs. As AI agents such as Claude Code, Gemini CLI, Codex, and others are increasingly used to generate and update code autonomously, developers often end up spending more time monitoring and sequencing these agents than writing or reviewing meaningful work. Vibe Kanban tackles this by enabling users to define tasks as cards on a board, assign those tasks to one or more coding agents, and then track progress and outcomes as each agent executes in the background with its own isolated workspace. It supports running multiple agents in parallel or in sequence, giving engineers the freedom to plan, review, and address higher-level concerns while AI helpers execute individual pieces of work. -
20
agentgateway
Next Generation Agentic Proxy for AI Agents and MCP servers
Agentgateway is an open-source “data plane” built specifically for agentic AI connectivity, focusing on how agents talk to other agents and to tools across different frameworks and environments. It presents itself as a complete connectivity solution that adds drop-in security, observability, and governance to agent-to-agent and agent-to-tool communication without requiring you to rebuild your agent stack. The project supports interoperable protocols designed for this ecosystem, including Agent2Agent (A2A) and Model Context Protocol (MCP), which helps standardize how tools and agents interoperate. It is designed for performance and scale, implemented in Rust and engineered to handle large throughput and multi-tenant deployments. Operationally, it emphasizes safety and control with an RBAC system tuned for MCP/A2A use cases, plus the ability to update configuration dynamically via xDS without downtime. -
21
mistral.rs
Fast, flexible LLM inference
mistral.rs is a fast and flexible LLM inference engine implemented in Rust, designed to run and serve modern language models with an emphasis on performance and practical deployment. It provides multiple entry points for developers, including a CLI for running models locally and an HTTP server that exposes an OpenAI-compatible API surface for easy integration with existing clients. The project includes hardware-aware tooling that can benchmark a system and choose sensible quantization and device-mapping strategies, helping users get strong performance without manual tuning. It also supports serving multiple models from the same server process, enabling routing or quick switching between models depending on workload needs. For user-facing testing, mistral.rs can provide a built-in web UI, and it also offers a dedicated lightweight web chat interface that supports richer interaction patterns. -
22
AppFlowy
Bring projects, wikis, and teams together with AI.
AppFlowy is an AI collaborative workspace where you can achieve more without losing control of your data. It is the best open source alternative to Notion, offering a 100% offline mode and self-hosting with a cloud service of your choice. Build a centralized workspace for your wiki, projects, and notes with AppFlowy. It allows you to organize and visualize your data in tables, Kanban boards, calendars, and more. You can filter and sort your data in any way you want. AppFlowy comes with a beautiful rich-text editor that goes beyond just text and bullet points, offering 20+ content types, easy-to-use customized themes, keyboard shortcuts, and color options. It supports real-time team collaboration, enabling you to work with your friends and teammates on the same document in real time, similar to Google Docs. AppFlowy is powered by AppFlowy AI, which is accessible, collaborative, and contextual. Supercharge any type of work in a collaborative team workspace. -
23
Shinkai: Local AI Agents
Shinkai allows you to create advanced AI (local) agents effortlessly
Shinkai is a free, open-source AI platform that lets anyone create powerful AI agents without coding. These agents can collaborate with each other, handle complex tasks, and operate in decentralized crypto environments. Key Features: - No-Code Agent Creation - Build specialized agents (trading bots, sentiment trackers, etc.) with simple descriptions - Multi-Agent Collaboration - Agents work together to solve complex problems - Crypto Integration - Built-in support for decentralized payments and transactions - Flexible AI Models - Choose from cloud models (GPT-4, Claude) or run locally - Universal Compatibility - Works with Model Context Protocol (MCP) for cross-platform integration - Local Security - Crypto keys and computations stay on your device Shinkai transforms AI from single-task tools into collaborative, autonomous systems that can operate in decentralized networks while maintaining privacy and security. -
24
Artificial Intelligence Controller
AICI: Prompts as (Wasm) Programs
AICI is a framework that allows developers to build controllers that constrain and direct the output of Large Language Models (LLMs). By treating prompts as WebAssembly (Wasm) programs, AICI enables more precise and controlled interactions with LLMs, enhancing their utility in various applications. This approach allows for the creation of more reliable and predictable AI-driven systems. -
25
ChatGPT Client
A ChatGPT client written in Rust
A ChatGPT client written in Rust. The ChatGPT model is a large language model trained by OpenAI that is capable of generating human-like text. By providing it with a prompt, it can generate responses that continue the conversation or expand on the given prompt.
