Search Results for "s3"
Sort By:
Showing 58 open source projects for "s3"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
1
s3fs
FUSE-based file system backed by Amazon S3
s3fs allows Linux, macOS, and FreeBSD to mount an S3 bucket via FUSE. s3fs preserves the native object format for files, allowing use of other tools like AWS CLI. Large subset of POSIX including reading/writing files, directories, symlinks, mode, uid/gid, and extended attributes. Compatible with Amazon S3, and other S3-based object stores. Allows random writes and appends, large files via multi-part upload, and renames via server-side copy. -
2
S3Proxy
S3Proxy implements the S3 API and proxies requests
S3Proxy implements the S3 API and proxies requests, enabling several use cases. Translation from S3 to Backblaze B2, EMC Atmos, Google Cloud, Microsoft Azure, and OpenStack Swift. Testing without Amazon by using the local filesystem. Extension via middleware. Embedding into Java applications. Docker Hub hosts a Docker image and has instructions on how to run it. -
3
django-dbbackup
Management commands to help backup and restore your project database
django-dbbackup is a Django management command extension for backing up and restoring databases and media files. It supports multiple storage backends including local file systems, Amazon S3, and Dropbox. Ideal for automated backup strategies, it simplifies the integration of backup logic into Django projects. -
4
Gobuster
Directory/File, DNS and VHost busting tool written in Go
...This project is born out of the necessity to have something that didn't have a fat Java GUI (console FTW), something that did not do recursive brute force, something that allowed me to brute force folders and multiple extensions at once, something that compiled to native on multiple platforms, something that was faster than an interpreted script (such as Python), and something that didn't require a runtime. Provides several modes, like the classic directory brute-forcing mode, DNS subdomain brute-forcing mode, the mode that enumerates open S3 buckets and looks for existence and bucket listings, and the virtual host brute-forcing mode (not the same as DNS!). Since this tool is written in Go you need to install the Go language/compiler/etc. Full details of installation and set up can be found on the Go language website. Once installed you have two options. You need at least go 1.16.0 to compile gobuster. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
OpenObserve
Elasticsearch/Splunk/Datadog alternative for (logs, metrics, traces)
...Below are the results when we pushed logs from our production Kubernetes cluster to Elasticsearch and OpenObserve using fluent bit. OpenObserve stored data in Amazon s3 and Elasticsearch stored data on Amazon EBS volumes. -
6
Logging operator
Logging operator for Kubernetes
...You can filter and process the incoming log messages using the flow custom resource of the log forwarder to route them to the appropriate output. The outputs are the destinations where you want to send your log messages, for example, Elasticsearch, or an Amazon S3 bucket. You can also define cluster-wide outputs and flows, for example, to use a centralized output that namespaced users can reference but cannot modify. -
7
parseable
Parseable is a log analytics system written in Rust
Parseable is a log analytics platform, built for the modern, cloud native era. Parseable uses a index-free mechanism to organize and query data allowing low latency, and high throughput ingestion and query. -
8
Kurrier
Workspace for email, calendar, contacts and storage
...For personal information management, Kurrier syncs calendars via CalDAV and contacts via CardDAV, making it compatible with common clients across desktop and mobile ecosystems. It also adds an integrated “Drive” concept that can use WebDAV locally and is intended to support S3-compatible storage backends as the project expands. The UI aims to feel fast and cohesive across modules, with features like multiple identities (useful for multi-domain or multi-sender setups) and organizational tooling such as labels. -
9
Vector
A high-performance observability data pipeline
Vector is a Rust‑based, high‑performance observability data pipeline tool (agent + aggregator) designed to collect, transform, and route logs and metrics at scale. Created by Datadog, it aims to be the only tool needed from ingestion to vendor output, providing cost-efficient, safe, and flexible telemetry processing. -
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
10
Grafana Loki
Multi-tenant log aggregation system inspired by Prometheus
...Unlike other logging systems, Loki is built around the idea of only indexing metadata about your logs: labels (just like Prometheus labels). Log data itself is then compressed and stored in chunks in object stores such as S3 or GCS, or even locally on the filesystem. A small index and highly compressed chunks simplifies the operation and significantly lowers the cost of Loki. Loki supports multi-tenancy so that data between tenants is completely separated. Multi-tenancy is achieved through a tenant ID (which is represented as an alphanumeric string). When multi-tenancy mode is disabled, all requests are internally given a tenant ID of “fake”. -
11
PGHoard
PostgreSQL® backup and restore service
pghoard is a PostgreSQL backup and restore tool that provides encrypted, compressed, and cloud-optimized backups. Developed by Aiven, it supports streaming WAL archiving and full base backups to various cloud storage backends. pghoard is designed for reliability and fast disaster recovery in cloud-native PostgreSQL deployments. -
12
ESPectre
Motion detection system based on Wi-Fi spectre analysis (CSI)
ESPectre is an open-source motion detection system that transforms ordinary Wi-Fi signals into an ambient sensor capable of detecting movement without using cameras, microphones, or additional radio hardware, making it a privacy-preserving and cost-effective alternative for presence sensing and smart home automation. At its core, it analyzes Wi-Fi Channel State Information (CSI) — detailed measurements of how Wi-Fi waves change as they propagate — to mathematically detect disturbances caused... -
13
Longhorn
Cloud-Native distributed block storage for Kubernetes
Historically, adding replicated storage to Kubernetes clusters has always been difficult, thus resulting in many non-cloud-hosted Kubernetes clusters not supporting persistent storage. Longhorn is the solution to this. Longhorn provides highly available, persistent storage for Kubernetes. It is lightweight, simplified, reliable and powerful. It’s easy to deploy and upgrade, cloud-native and best of all, completely free and open source. Longhorn has built-in incremental snapshot and backup... -
14
OpenArchiver
An open-source platform for legally compliant email archiving
OpenArchiver is a comprehensive, self-hosted email archiving and compliance platform built to help organizations ingest, index, store, and search email communication data across diverse sources like Gmail, Microsoft 365, IMAP, PST, and more. It’s designed for scenarios where reliable, tamper-proof archiving and full-text search across both emails and attachments are essential for legal discovery, compliance, or long-term records retention. The platform combines a modern web UI with powerful... -
15
Postgres Operator
Postgres operator creates and manages PostgreSQL clusters
The Postgres Operator delivers easy-to-run highly available PostgreSQL clusters on Kubernetes (K8s) powered by Patroni. It is configured only through Postgres manifests (CRDs) to ease integration into automated CI/CD pipelines with no access to Kubernetes API directly, promoting infrastructure as code vs manual operations. -
16
SeaweedFS
Distributed storage system for blobs, objects, files, and data lake
SeaweedFS is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV. SeaweedFS is an independent Apache-licensed open source project with its ongoing development made possible because of the community. SeaweedFS is a simple and highly scalable distributed file system. There are two objectives, to store billions of files, and to serve the files fast! ... -
17
MinIO Operator
Simple Kubernetes Operator for MinIO clusters
MinIO is a Kubernetes-native high-performance object store with an S3-compatible API. The MinIO Kubernetes Operator supports deploying MinIO Tenants onto private and public cloud infrastructures ("Hybrid" Cloud). Each MinIO Tenant represents an independent MinIO Object Store within the Kubernetes cluster. The following diagram describes the architecture of a MinIO Tenant deployed into Kubernetes. The MinIO Console provides a graphical user interface (GUI) for interacting with MinIO Tenants. ... -
18
qryn
All-in-one Polyglot Observability stack with ClickHouse storage
All the greatest observability formats and integrations you love, at once - LGTM Drop-in compatible. Let's get Polyglot. qryn independently implements popular observability standards, protocols and query languages. Make sure you have sufficient memory and disk resources allocated for your node service and clickhouse server when dealing with large amounts of data and fingerprints. We suggest 8GB RAM or higher for most setups with 100k-1M fingerprints. Observe your daily and weekly data... -
19
ZeroByte
Backup automation for self-hosters
...Zerobyte lets you configure automated jobs with flexible schedules and retention policies, monitor backup jobs through a centralized dashboard, and choose from multiple source types (like local directories, NFS, SMB, WebDAV, and more), all while ensuring end-to-end encryption via Restic underneath. The system also supports common remote destinations such as S3-compatible storage or REST servers and encapsulates much of the complexity of backup logic so users can focus on reliability and restore confidence rather than manual orchestration. -
20
Reposilite
Lightweight and easy-to-use repository management software
Lightweight and easy-to-use repository manager for Maven-based artifacts in JVM ecosystem. This is simple, extensible and scalable self-hosted solution to replace managers like Nexus, Archiva, or Artifactory, with reduced resource consumption. To run Reposilite for your personal needs you should assign around 20MB of RAM and at least Java 11+ installed. For huge public repositories, you can adjust the memory limit and even the size of used thread pools in the configuration. The recommended... -
21
SlateDB
A cloud native embedded storage engine built on object storage
Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage to provide bottomless storage capacity, high durability, and easy replication. SlateDB is an embedded storage engine built as a log-structured merge-tree. Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage (S3, GCS, ABS, MinIO, Tigris, and so on). Leveraging object storage allows SlateDB to provide bottomless storage capacity, high durability, and easy replication. The trade-off is that object storage has a higher latency and higher API cost than local disk. To mitigate high write API costs (PUTs), SlateDB batches writes. Rather than writing every put() call to object storage, MemTables are flushed periodically to object storage as a string-sorted table (SST). ... -
22
SDGym
Benchmarking synthetic data generation methods
The Synthetic Data Gym (SDGym) is a benchmarking framework for modeling and generating synthetic data. Measure performance and memory usage across different synthetic data modeling techniques – classical statistics, deep learning and more! The SDGym library integrates with the Synthetic Data Vault ecosystem. You can use any of its synthesizers, datasets or metrics for benchmarking. You also customize the process to include your own work. Select any of the publicly available datasets from the... -
23
cozystack
PaaS and framework that replace or compete with AWS, VMware
Open Source AI-ready PaaS and framework for building your own cloud on bare metal and running managed Kubernetes, virtual machines, Databases-as-a-Service or for creating your own AWS/GCP/Azure competitor for ISP/MSP/hosting providers. CNCF Project - Control your data - Cut dependence from the tech giants - Enable digital sovereignty - Use modern tools and APIs with any server - Fully utilize GPU resources for AI Who is it for? Banks and fintechs, AI-driven companies, service... -
24
TN 365 OS Maia 2026
Distribution TN 365 KDE moderne et stable !
🇫🇷 TechNews365 OS Essentials – Édition KDE / (Base KDE Néon) TechNews365 OS Essentials est une distribution Linux moderne, rapide et légère, basée sur KDE Néon. Elle offre une expérience simple, propre et optimisée pour le quotidien : KDE optimisé TN365 Thème Maia Transparent et icônes personnalisés Applications Essentielles incluse Radios, jeux légers, outils multimédia Calamares (installation simple et rapide) Système stable, rapide et 100% FR 👉... -
25
XSIBackup-App
Backup and replicate Linux files, databases and ©VMWare ©ESXi VMs
...https://33hops.com/xsibackup-app-detailed-installation-instructions.html ©XSIBackup-App connects to multiple Linux or ©ESXi servers and backs VMs & files up to, local disk, NFS, iSCSI, Samba, etc... or to any Linux or ©ESXi server over IP, it just needs the SSH port open. This appliance is based in CentOS 7 and has root access. You can install any available software, including drivers for Amazon S3, Azure, Google Cloud, etc... We have improved speed with regards to the hypervisor service versions, mainly due to more flexible buffering. It follows the same principles and command line arguments as ©XSIBackup-DC. This new approach has many advantages over the software running directly in the Hypervisor OS, as it can backup an unlimited number of servers from a centralized console and you don't need to install anything in the Hypervisor OS
