Showing 87 open source projects for "linux ai"

View related business solutions
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • Enterprise-grade ITSM, for every business Icon
    Enterprise-grade ITSM, for every business

    Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity.

    Freshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
    Try it Free
  • 1
    CocoIndex

    CocoIndex

    ETL framework to index data for AI, such as RAG

    CocoIndex is an open-source framework designed for building powerful, local-first semantic search systems. It lets users index and retrieve content based on meaning rather than keywords, making it ideal for modern AI-based search applications. CocoIndex leverages vector embeddings and integrates with various models and frameworks, including OpenAI and Hugging Face, to provide high-quality semantic understanding. It’s built for transparency, ease of use, and local control over your search...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    Daft

    Daft

    Distributed DataFrame for Python designed for the cloud

    Daft is a framework for ETL, analytics and ML/AI at scale. Its familiar Python Dataframe API is built to outperform Spark in performance and ease of use. Daft plugs directly into your ML/AI stack through efficient zero-copy integrations with essential Python libraries such as Pytorch and Ray. It also allows requesting GPUs as a resource for running models. Daft runs locally with a lightweight multithreaded backend. When your local machine is no longer sufficient, it scales seamlessly to run...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    MusicGPT

    MusicGPT

    Generate music based on natural language prompts using LLMs

    ...Instead, it provides a lightweight environment capable of executing music generation models locally on CPUs or GPUs while maintaining strong performance across operating systems including Windows, macOS, and Linux. Users can describe a musical style, mood, or instrumentation using text prompts, and the system produces original audio samples based on those instructions. The application currently integrates with models such as MusicGen and is designed to support additional models transparently in the future. In addition to a command-line interface, the project includes a web-based interface that enables conversational interaction with the AI model.
    Downloads: 9 This Week
    Last Update:
    See Project
  • 4
    Rust Docs MCP Server

    Rust Docs MCP Server

    Prevents outdated Rust code suggestions from AI assistants

    The Rust Docs MCP Server fetches documentation for specified Rust crates, generates embeddings for the content, and provides an MCP tool to answer questions about the crate based on the documentation context. ​
    Downloads: 0 This Week
    Last Update:
    See Project
  • Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
    Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

    General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

    Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
    Try Free
  • 5
    Qdrant

    Qdrant

    Vector Database for the next generation of AI applications

    Qdrant is a vector similarity engine & vector database. It deploys as an API service providing search for the nearest high-dimensional vectors. With Qdrant, embeddings or neural network encoders can be turned into full-fledged applications for matching, searching, recommending, and much more! Provides the OpenAPI v3 specification to generate a client library in almost any programming language. Alternatively, utilize ready-made client for Python or other programming languages with additional...
    Downloads: 66 This Week
    Last Update:
    See Project
  • 6
    Sail

    Sail

    A drop-in Apache Spark replacement written in Rust

    Sail is an open-source distributed computation framework designed to unify batch processing, stream processing, and AI workloads into a single, high-performance engine. It is built entirely in Rust, eliminating JVM overhead and enabling predictable performance, fast startup times, and improved memory safety compared to traditional big data frameworks. Sail is compatible with the Spark Connect protocol, which means existing Spark SQL and DataFrame workloads can run without code changes,...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 7
    HelixDB

    HelixDB

    Graph-vector database for building unified AI backends fast

    HelixDB is an open source database designed to unify multiple data storage paradigms into a single platform tailored for AI-driven applications. It combines graph and vector data models, allowing developers to manage relationships and embeddings within the same system without relying on separate services. HelixDB is built from scratch in Rust and uses LMDB as its storage engine, enabling high performance and low-latency query execution. HelixDB also supports additional data formats such as...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    Rig

    Rig

    Rust framework for building modular and scalable LLM-powered apps

    Rig is an open source Rust framework designed to help developers build modular and scalable applications powered by large language models. It provides a unified set of abstractions that allow applications to interact with many AI model providers and vector databases through a single interface. Its architecture emphasizes modularity, enabling developers to integrate only the components and integrations they need for a specific application. Rig includes built-in support for agent workflows,...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    LangChain Rust

    LangChain Rust

    LangChain for Rust, the easiest way to write LLM-based programs

    LangChain Rust is an open-source Rust implementation inspired by the LangChain ecosystem for building applications powered by large language models. The library aims to provide Rust developers with a structured framework for orchestrating prompts, chains, agents, and external tools within LLM-driven workflows. By adapting LangChain concepts to the Rust programming language, the project emphasizes performance, safety, and efficient memory management. Developers can use the framework to build...
    Downloads: 0 This Week
    Last Update:
    See Project
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 10
    shimmy

    shimmy

    Python-free Rust inference server

    The shimmy project is a lightweight local inference server designed to run large language models with minimal overhead. Written primarily in Rust, the tool provides a small standalone binary that exposes an API compatible with the OpenAI interface, allowing existing applications to interact with local models without significant code changes. This compatibility enables developers to replace remote AI services with locally hosted models while keeping their existing software architecture...
    Downloads: 4 This Week
    Last Update:
    See Project
  • 11
    agentgateway

    agentgateway

    Next Generation Agentic Proxy for AI Agents and MCP servers

    Agentgateway is an open-source “data plane” built specifically for agentic AI connectivity, focusing on how agents talk to other agents and to tools across different frameworks and environments. It presents itself as a complete connectivity solution that adds drop-in security, observability, and governance to agent-to-agent and agent-to-tool communication without requiring you to rebuild your agent stack. The project supports interoperable protocols designed for this ecosystem, including...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 12
    webclaw

    webclaw

    Fast, local-first web content extraction for LLMs

    webclaw is a high-performance web content extraction tool designed specifically for AI agents and large language models, focusing on delivering clean, structured data instead of raw HTML. It is built in Rust and operates without a headless browser, using advanced techniques such as TLS fingerprinting to bypass common scraping barriers and mimic real browser behavior. The tool addresses a major inefficiency in AI workflows by removing irrelevant elements like navigation menus, ads, and...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 13
    Bionic GPT

    Bionic GPT

    Bionic is an on-premise replacement for ChatGPT

    Bionic is an on-premise generative AI platform positioned as a private replacement for ChatGPT, with a strong emphasis on data confidentiality, team collaboration, and enterprise deployment. It can run locally on a laptop for small pilots, but it is also designed to scale into data center and Kubernetes environments for much larger usage. The interface is intentionally familiar, offering a ChatGPT-like experience with customizable branding, fast Rust-based performance, and conversation...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14
    Ralph Orchestrator

    Ralph Orchestrator

    An improved implementation of the Ralph Wiggum technique

    Ralph Orchestrator is an AI workflow orchestration system designed to coordinate multiple agents, tools, and processes into structured pipelines that can execute complex tasks autonomously. It provides a framework for defining workflows where different components, such as LLMs, APIs, and custom functions, collaborate to achieve specific objectives. The system emphasizes modularity and composability, allowing developers to design workflows as reusable building blocks that can be combined or...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    OWS - Open Wallet Standard

    OWS - Open Wallet Standard

    Local, policy-gated signing and wallet management for every chain

    Open Wallet Standard Core is a foundational library that defines a set of interfaces and conventions for integrating cryptocurrency wallets with decentralized applications in a consistent and interoperable way. It establishes a standardized method for wallets to expose functionality such as account management, transaction signing, and connection handling, enabling seamless interaction across different blockchain ecosystems. The project focuses on improving both developer experience and user...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16
    DeepProve

    DeepProve

    Framework to prove inference of ML models blazingly fast

    DeepProve is an advanced cryptographic framework designed to verify machine learning model inference using zero-knowledge proofs, enabling trustless validation of AI computations without exposing underlying data. The project focuses on zkML, a rapidly emerging field that combines machine learning with zero-knowledge cryptography to ensure both privacy and correctness. It supports neural network architectures such as multilayer perceptrons and convolutional neural networks, allowing...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    OpenAI Harmony

    OpenAI Harmony

    Renderer for the harmony response format to be used with gpt-oss

    Harmony is a response format developed by OpenAI for use with the gpt-oss model series. It defines a structured way for language models to produce outputs, including regular text, reasoning traces, tool calls, and structured data. By mimicking the OpenAI Responses API, Harmony provides developers with a familiar interface while enabling more advanced capabilities such as multiple output channels, instruction hierarchies, and tool namespaces. The format is essential for ensuring gpt-oss...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 18
    Microsandbox

    Microsandbox

    Secure local-first microVM sandbox for running untrusted code fast

    Microsandbox is an open source platform designed to securely execute untrusted code in isolated environments using lightweight virtualization techniques. It focuses on combining strong security guarantees with fast startup times by leveraging hardware-level microVM isolation instead of relying solely on traditional containers or full virtual machines. It aims to solve the common tradeoffs between speed, isolation, and control that developers encounter when running untrusted workloads. It...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    DeepReasoning

    DeepReasoning

    High-performance API combining reasoning and creative AI models

    DeepReasoning is a high-performance large language model inference API designed to unify advanced reasoning and creative generation capabilities into a single system. It combines DeepSeek R1’s chain-of-thought reasoning with Claude’s strengths in code generation and conversational output, enabling more capable and balanced responses. DeepReasoning provides both an API and a chat interface, allowing developers and users to interact with the combined models in a streamlined way. It emphasizes...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Databend

    Databend

    Cloud-native open source data warehouse for analytics and AI queries

    Databend is an open source cloud-native data warehouse designed for large-scale analytics and modern data workloads. Built in Rust, the system focuses on high performance, scalability, and efficient data processing for analytical queries. It is designed with a separation of compute and storage, allowing compute nodes to scale independently while storing data in object storage systems. This architecture enables cost-efficient storage and elastic scaling for workloads that involve large...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    Amazon Q Developer CLI

    Amazon Q Developer CLI

    Chat experience in your terminal

    Amazon Q Developer CLI brings an agentic, chat-driven coding assistant to your terminal so you can ask for help, generate code, and perform routine dev tasks with natural language. It blends knowledge of your local workspace with command-line context to suggest commands, explain flags, and scaffold files or workflows. The tool aims to shorten the gap between intent and action by letting you request operations like creating a test, refactoring a function, or drafting a Dockerfile without...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    Burn

    Burn

    Burn is a new comprehensive dynamic Deep Learning Framework

    Burn is a new comprehensive dynamic Deep Learning Framework from Tracel AI built using Rust with extreme flexibility, compute efficiency and portability as its primary goals. Burn emphasizes performance, flexibility, and portability for both training and inference. Developed in Rust, it is designed to empower machine learning engineers and researchers across industry and academia.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 23
    gptcommit

    gptcommit

    A git prepare-commit-msg hook for authoring commit messages with GPT-3

    A git prepare-commit-msg hook for authoring commit messages with GPT-3. With this tool, you can easily generate clear, comprehensive and descriptive commit messages letting you focus on writing code. To use gptcommit, simply run git commit as you normally would. The hook will automatically generate a commit message for you using a large language model like GPT. If you're not satisfied with the generated message, you can always edit it before committing. By default, gptcommit uses the GPT-3...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    VectorChord

    VectorChord

    Scalable, fast, and disk-friendly vector search in Postgres

    VectorChord is an open-source vector database built for local and edge deployment. It supports efficient vector indexing and retrieval using ANN (approximate nearest neighbor) algorithms and is optimized for integration with LLM and AI applications. VectorChord is lightweight and can be embedded in a variety of environments for fast semantic search.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    PostgresML

    PostgresML

    The GPU-powered AI application database

    PostgresML is a complete platform in a PostgreSQL extension. Build simpler, faster, and more scalable models right inside your database. Explore the SDK and test open source models in our hosted database. Combine and automate the entire workflow from embedding generation to indexing and querying for the simplest (and fastest) knowledge-based chatbot implementation. Leverage multiple types of natural language processing and machine learning models such as vector search and personalization...
    Downloads: 0 This Week
    Last Update:
    See Project
MongoDB Logo MongoDB