Showing 290 open source projects for "s3"

View related business solutions
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New customers can spin up VMs, build with AI, and query data at no cost.

    Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
    Start Free
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Start Free
  • 1
    Cookiecutter Django

    Cookiecutter Django

    Framework for jumpstarting production-ready Django projects quickly

    ...Provides an optional basic ASGI setup for Websockets and an optional custom static build using Gulp and livereload. Send emails via Anymail (using Mailgun by default or Amazon SES if AWS is selected cloud provider, but switchable). Media storage using Amazon S3 or Google Cloud Storage. Docker support using docker-compose for development and production (using Traefik with LetsEncrypt support). Procfile for deploying to Heroku. Provides instructions for deploying to PythonAnywhere. You can run tests with unittest or pytest.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 2
    celld

    celld

    Self-hosted, distributed Durable Objects

    ...It supports Workers, Durable Objects, KV, Queues, D1, R2, Workflows, Cron Triggers, static assets, and experimental containers. Each stateful object operates as an isolated cell backed by its own SQLite database. Multiple celld nodes can form a fleet that shares durable state through S3-compatible storage, Google Cloud Storage, or Azure Blob Storage. The design avoids a separate consensus service or serving control plane by coordinating ownership through object storage. V8 executes Wrangler-compatible bundles, while replicated SQLite logs provide durability and failover between nodes. Local development can run without a cloud bucket, and production deployments support Docker and standard load-balanced infrastructure.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 3
    walgit

    walgit

    A git server that is one binary in front of an object store

    walgit is a lightweight Git server designed around object storage rather than traditional server-local repository state. A single binary can host repositories whose durable data resides in S3-compatible storage or Google Cloud Storage. It supports standard Git fetch and push operations over Smart HTTP, including protocol versions 0 and 2. Bundle-based cloning and Git LFS are included for handling repositories and large files efficiently. Users also get a repository browsing interface, JSON API, SDK, webhooks, and configurable push policies. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    GLAuth

    GLAuth

    A lightweight LDAP server for development, home use

    ...Centrally manage SSH keys, Linux accounts, and passwords for cloud servers. Lightweight alternative to OpenLDAP and Active Directory for development, or a homelab. Store your user directory in a file, local or in S3; SQL database; or proxy to existing LDAP servers. Two Factor Authentication (transparent to applications) Multiple backends can be chained to inject features. Use it to centralize account management across your Linux servers, your OSX machines, and your support applications (Jenkins, Apache/Nginx, Graylog2, and many more!).
    Downloads: 0 This Week
    Last Update:
    See Project
  • Train ML Models With SQL You Already Know Icon
    Train ML Models With SQL You Already Know

    BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

    Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
    Start Free
  • 5
    CTFd

    CTFd

    CTFs as you need them

    ...Challenge plugin architecture to create your own custom challenges. Static & Regex-based flags. Custom flag plugins. Unlockable hints. File uploads to the server or an Amazon S3-compatible backend. Limit challenge attempts & hide challenges. Automatic bruteforce protection. Individual and Team-based competitions. Have users play on their own or form teams to play together. Scoreboard with automatic tie resolution. Hide Scores from the public. Freeze Scores at a specific time. Scoregraphs comparing the top 10 teams and team progress graphs. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 6
    Cloudreve

    Cloudreve

    Self-hosted file management and sharing system

    Cloudreve is a full-featured self-hosted file management and sharing system. It supports multi-cloud storage backends, user/group permissions, file previews/editing, offline downloading via Aria2, and a polished web/PWA frontend.
    Downloads: 17 This Week
    Last Update:
    See Project
  • 7
    AWS SDK for pandas

    AWS SDK for pandas

    Easy integration with Athena, Glue, Redshift, Timestream, Neptune

    aws-sdk-pandas (formerly AWS Data Wrangler) bridges pandas with the AWS analytics stack so DataFrames flow seamlessly to and from cloud services. With a few lines of code, you can read from and write to Amazon S3 in Parquet/CSV/JSON/ORC, register tables in the AWS Glue Data Catalog, and query with Amazon Athena directly into pandas. The library abstracts efficient patterns like partitioning, compression, and vectorized I/O so you get performant data lake operations without hand-rolling boilerplate. It also supports Redshift, OpenSearch, and other services, enabling ETL tasks that blend SQL engines and Python transformations. ...
    Downloads: 2 This Week
    Last Update:
    See Project
  • 8
    Agent S

    Agent S

    Agent S: an open agentic framework that uses computers like a human

    ...Built to operate graphical user interfaces like a human, it allows AI agents to perceive screens, reason about tasks, and execute actions across macOS, Windows, and Linux systems. The latest version, Agent S3, surpasses human-level performance on the OSWorld benchmark, demonstrating state-of-the-art results in complex multi-step computer tasks. Agent S combines powerful foundation models (such as GPT-5) with grounding models like UI-TARS to translate visual inputs into precise executable actions. It supports flexible deployment via CLI, SDK, or cloud, and integrates with multiple model providers including OpenAI, Anthropic, Gemini, Azure, and Hugging Face endpoints. ...
    Downloads: 12 This Week
    Last Update:
    See Project
  • 9
    Alexandrie

    Alexandrie

    Web application for Markdown note taking

    ...The application runs as a responsive web interface that works online or offline, with search and export features that help users retrieve and reuse their content effectively. Built with a clear focus on productivity, Alexandrie includes support for custom storage backends like S3-compatible services or local file systems via Docker Compose setups. Its extended Markdown syntax lets users embed rich content, multimedia references, and structured blocks that go beyond plain text, while the sleek UI encourages distraction-free writing and review.
    Downloads: 0 This Week
    Last Update:
    See Project
  • PRTG Catches Network Issues Before They Cause Downtime Icon
    PRTG Catches Network Issues Before They Cause Downtime

    Threshold-based alerts flag problems early, so your team can act before users notice, not after.

    Reactive troubleshooting usually means hearing about a problem from frustrated users, not your monitoring tool. PRTG sets threshold-based alerts across devices, servers and applications, notifying your team by email, SMS or push the moment a metric crosses a set limit. That means catching a failing disk or overloaded server before it becomes an outage and getting time back from firefighting. Start a free trial and set your first alerts today.
    Download 30-Day Trial
  • 10
    ESP32 Bit Pirate

    ESP32 Bit Pirate

    A Hardware Hacking Tool with Web-Based CLI That Speaks Every Protocol

    ...The firmware can sniff traffic, send data, read memory devices, scan interfaces, manipulate pins, and automate operations with scripts. Additional modes cover JTAG, USB, Ethernet, I2S, LEDs, cellular modules, and signal analysis. Its broad hardware support ranges from generic ESP32-S3 boards to several LILYGO and M5Stack devices.
    Downloads: 94 This Week
    Last Update:
    See Project
  • 11
    Lance

    Lance

    Modern columnar data format for ML and LLMs implemented in Rust

    Lance is a columnar data format that is easy and fast to version, query and train on. It’s designed to be used with images, videos, 3D point clouds, audio and of course tabular data. It supports any POSIX file systems, and cloud storage like AWS S3 and Google Cloud Storage.
    Downloads: 10 This Week
    Last Update:
    See Project
  • 12
    Argo Events

    Argo Events

    Event-driven Automation Framework for Kubernetes

    ...It allows you to trigger 10 different actions (such as the creation of Kubernetes objects, invoking workflows or serverless workloads) on over 20 different events (such as webhook, S3 drop, cron schedule, messaging queues - e.g. Kafka, GCP PubSub, SNS, SQS).
    Downloads: 10 This Week
    Last Update:
    See Project
  • 13
    Gigapipe

    Gigapipe

    The Open-Source Polyglot Observability Warehouse

    Gigapipe is an open-source, polyglot observability platform designed to unify logs, metrics, traces, and profiling data into a single, lightweight system. It serves as an all-in-one alternative to traditional observability stacks by implementing compatibility with widely used standards such as Loki, Prometheus, Tempo, and Pyroscope, allowing it to integrate seamlessly with existing tools and workflows. The platform supports ingestion from multiple sources, including OpenTelemetry and various...
    Downloads: 45 This Week
    Last Update:
    See Project
  • 14
    Quickwit

    Quickwit

    Sub-second search & analytics engine on cloud storage

    Sub-second search & analytics engine on cloud storage. Quickwit is the fastest search engine on cloud storage. Quickwit has an Elasticsearch-compatible Ingest-API to make it easier to migrate your log shippers (Vector, Fluent Bit, Syslog, ...) to Quickwit. However, we only support ES aggregation DSL, the query DSL support is planned for Q2 2023. The core difference and advantage of Quickwit are its architecture built from the ground to search on cloud storage. We optimized IO paths, revamped...
    Downloads: 27 This Week
    Last Update:
    See Project
  • 15
    Helmfile

    Helmfile

    Declaratively deploy your Kubernetes manifests, Kustomize configs

    Deploy Kubernetes Helm Charts. Declaratively deploy your Kubernetes manifests, Customize configs, and Charts as Helm releases. Generate all-in-one manifests for use with ArgoCD. Keep a directory of chart value files and maintain changes in version control. Apply CI/CD to configuration changes. Periodically sync to avoid skew in environments.
    Downloads: 15 This Week
    Last Update:
    See Project
  • 16
    qryn

    qryn

    All-in-one Polyglot Observability stack with ClickHouse storage

    All the greatest observability formats and integrations you love, at once - LGTM Drop-in compatible. Let's get Polyglot. qryn independently implements popular observability standards, protocols and query languages. Make sure you have sufficient memory and disk resources allocated for your node service and clickhouse server when dealing with large amounts of data and fingerprints. We suggest 8GB RAM or higher for most setups with 100k-1M fingerprints. Observe your daily and weekly data...
    Downloads: 42 This Week
    Last Update:
    See Project
  • 17
    Gaufrette

    Gaufrette

    PHP library that provides a filesystem abstraction layer

    Gaufrette is a PHP library designed to abstract filesystem operations, providing a consistent interface to interact with various storage backends. It allows developers to work with files stored locally, on cloud platforms, or via network protocols, without changing the code. Gaufrette supports plugins for caching, metadata management, and file transformation, making it a flexible choice for file management in web applications.
    Downloads: 7 This Week
    Last Update:
    See Project
  • 18
    Rclone

    Rclone

    Rsync for cloud storage

    Rclone is a command line program for syncing files and directories to and from various cloud storage providers, including Google Drive, Amazon Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Cloudfiles, Google Cloud Storage, Yandex Files and many more.
    Downloads: 24 This Week
    Last Update:
    See Project
  • 19
    Jitsu

    Jitsu

    Jitsu is an open-source Segment alternative

    ...Jitsu is built to be framework agnostic, so regardless of your stack, we have a solution that'll work for your team. Connect data warehouse (Snowflake, Clickhouse, BigQuery, S3, Redshift ot Postgres) and query your data instantly. Jitsu can either stream data in real-time or send it in micro-batches (up to once a minute). Apply any transformation with Jitsu. Just write JavaScript code right in the UI to do anything with incoming data. And yes, the code editor supports code completion, debugging and many more. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    ArcticDB

    ArcticDB

    ArcticDB is a high performance, serverless DataFrame database

    Built for the modern Python Data Science ecosystem, ArcticDB transforms your ability to handle complex real-world data with an Incredibly fast proven Petabyte scale. ArcticDB is designed with quant users in mind. It allows you to self-manage your data leveraging your preferred infrastructure. Giving you the keys to protect your most valuable asset. Supports large concurrent writes to many tables ensuring datasets can be onboarded fast and in the most convenient format. Scale-out architecture...
    Downloads: 31 This Week
    Last Update:
    See Project
  • 21
    Gnomock

    Gnomock

    Test your code without writing mocks with ephemeral Docker containers

    ...The power of Gnomock is in a variety of Presets, each implementing a specific database, service, or other tools. Each preset provides ways of setting up its initial state as easily as possible: SQL schema creation, test data upload into S3, sending test events to Splunk, etc.
    Downloads: 9 This Week
    Last Update:
    See Project
  • 22
    imagor

    imagor

    Fast, secure image processing server and Go library, using libvips

    Imagor is a fast, Docker-ready image processing server built in Go, ideal for on-the-fly image resizing, cropping, filtering, and optimization. It supports a wide variety of image formats and integrates seamlessly with cloud storage backends like AWS S3 and Google Cloud Storage. With support for HTTP and gRPC APIs, Imagor can be used in production environments to serve optimized images dynamically with high performance and low latency.
    Downloads: 6 This Week
    Last Update:
    See Project
  • 23
    AWS Chalice

    AWS Chalice

    Python Serverless Microframework for AWS

    ...You define routes, event handlers, and background tasks in plain Python, and Chalice turns them into AWS Lambda functions wired to API Gateway, Amazon EventBridge schedulers, S3/SNS/SQS triggers, and more. A single command builds your app, bundles dependencies, generates infrastructure templates, and deploys to your account with sensible defaults. The framework includes local development tools so you can iterate on HTTP routes and inspect logs before shipping to the cloud. It also manages per-stage configuration, environment variables, IAM permissions scaffolding, and packaging optimizations to keep cold starts small. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    Budibase

    Budibase

    Create business apps and automate workflows in minutes

    ...You can also code against Budibase or fork it and make changes as you please, providing a developer-friendly experience. Budibase pulls data from multiple sources, including MongoDB, CouchDB, PostgreSQL, MariaDB, MySQL, Airtable, S3, DynamoDB, or a REST API. And unlike other platforms, with Budibase you can start from scratch and create business apps with no data sources. Request new data sources.
    Downloads: 23 This Week
    Last Update:
    See Project
  • 25
    Thanos

    Thanos

    Highly available Prometheus setup with long term storage capabilities

    ...Scale your Prometheus setup by enabling querying of your Prometheus metrics across multiple Prometheus servers and clusters. Extend the system with the object storage of your choice to store your metrics for an unlimited time. Supports GCP, S3, Azure, Swift and Tencent COS. Use the same tools you love, such as Grafana and others, that support the Prometheus Query API. Downsample historical data for massive query speedup when querying large time ranges or configure complex retention policies. Thanos leverages the Prometheus 2.0 storage format to cost-efficiently store historical metric data in any object storage while retaining fast query latencies. ...
    Downloads: 22 This Week
    Last Update:
    See Project