Browse free open source Python LLM Gateways and projects below. Use the toggles on the left to filter open source Python LLM Gateways by OS, license, language, programming language, and project status.

  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New customers can spin up VMs, build with AI, and query data at no cost.

    Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
    Start Free
  • Fully Managed MySQL, PostgreSQL, and SQL Server Icon
    Fully Managed MySQL, PostgreSQL, and SQL Server

    Automatic backups, patching, replication, and failover. Focus on your app, not your database.

    Cloud SQL handles your database ops end to end, so you can focus on your app.
    Start Free
  • 1
    OptScale

    OptScale

    FinOps and MLOps platform to run ML/AI and regular cloud workloads

    Run ML/AI or any type of workload with optimal performance and infrastructure cost. OptScale allows ML teams to multiply the number of ML/AI experiments running in parallel while efficiently managing and minimizing costs associated with cloud and infrastructure resources. OptScale MLOps capabilities include ML model leaderboards, performance bottleneck identification and optimization, bulk run of ML/AI experiments, experiment tracking, and more. The solution enables ML/AI engineers to run automated experiments based on datasets and hyperparameter conditions within the defined infrastructure budget. Certified FinOps solution with the best cloud cost optimization engine, providing rightsizing recommendations, Reserved Instances/Savings Plans, and dozens of other optimization scenarios. With OptScale, users get complete cloud resource usage transparency, anomaly detection, and extensive functionality to avoid budget overruns.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2
    Wiro AI for Hermes Agent

    Wiro AI for Hermes Agent

    Wiro AI tools and LLM provider for Hermes Agent, on one API key

    Wiro-Hermes brings Wiro AI to Hermes Agent with two plugins. wiro-media adds thirteen wiro_* tools: generate and edit images, make video from a prompt or a picture, read text aloud, compose music, transcribe audio, build 3D models, search the catalog of 1,000+ models with prices, and run any model or workflow. It also makes Wiro AI the backend of Hermes' own image, video, text to speech and voice note tools. The wiro plugin adds the Wiro AI LLM gateway as a model provider: GPT, Claude, Gemini, DeepSeek, GLM, Kimi and Grok models on one OpenAI-compatible API. Install one or both; runs are paid as you go from your Wiro AI wallet.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    Wiro AI plugins for Dify

    Wiro AI plugins for Dify

    Wiro AI model provider and media tools for Dify workflows and agents

    This repository holds two Dify plugins that share one Wiro AI project API key. Wiro AI is a model provider: chat models from OpenAI, Anthropic, Google, xAI, DeepSeek, Qwen and more through the Wiro AI LLM gateway, with context sizes, output limits, prices, vision, PDF input, tool calling and JSON Schema output filled in for each model, plus text to speech and speech to text models for Dify's voice features. Wiro AI Media adds tools to generate, edit and upscale images, remove backgrounds, and make videos, speech, music and 3D models with 1,000+ models in Dify workflows and agents. Your saved Wiro AI workflows, Studio and agents run from Dify too.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    llmui-core V1.0
    free llm plateform on-premise
    Downloads: 0 This Week
    Last Update:
    See Project
  • Train ML Models With SQL You Already Know Icon
    Train ML Models With SQL You Already Know

    BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

    Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
    Start Free
  • Previous
  • You're on page 1
  • Next