Search Results for "s3"
Sort By:
Showing 46 open source projects for "s3"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
1
s3fs
FUSE-based file system backed by Amazon S3
s3fs allows Linux, macOS, and FreeBSD to mount an S3 bucket via FUSE. s3fs preserves the native object format for files, allowing use of other tools like AWS CLI. Large subset of POSIX including reading/writing files, directories, symlinks, mode, uid/gid, and extended attributes. Compatible with Amazon S3, and other S3-based object stores. Allows random writes and appends, large files via multi-part upload, and renames via server-side copy. -
2
S3Proxy
S3Proxy implements the S3 API and proxies requests
S3Proxy implements the S3 API and proxies requests, enabling several use cases. Translation from S3 to Backblaze B2, EMC Atmos, Google Cloud, Microsoft Azure, and OpenStack Swift. Testing without Amazon by using the local filesystem. Extension via middleware. Embedding into Java applications. Docker Hub hosts a Docker image and has instructions on how to run it. -
3
django-dbbackup
Management commands to help backup and restore your project database
django-dbbackup is a Django management command extension for backing up and restoring databases and media files. It supports multiple storage backends including local file systems, Amazon S3, and Dropbox. Ideal for automated backup strategies, it simplifies the integration of backup logic into Django projects. -
4
OpenObserve
Elasticsearch/Splunk/Datadog alternative for (logs, metrics, traces)
...Below are the results when we pushed logs from our production Kubernetes cluster to Elasticsearch and OpenObserve using fluent bit. OpenObserve stored data in Amazon s3 and Elasticsearch stored data on Amazon EBS volumes. -
Stop Cyber Threats with VM-Series Next-Gen Firewall on AzureGain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.
-
5
Logging operator
Logging operator for Kubernetes
...You can filter and process the incoming log messages using the flow custom resource of the log forwarder to route them to the appropriate output. The outputs are the destinations where you want to send your log messages, for example, Elasticsearch, or an Amazon S3 bucket. You can also define cluster-wide outputs and flows, for example, to use a centralized output that namespaced users can reference but cannot modify. -
6
parseable
Parseable is a log analytics system written in Rust
Parseable is a log analytics platform, built for the modern, cloud native era. Parseable uses a index-free mechanism to organize and query data allowing low latency, and high throughput ingestion and query. -
7
Kurrier
Workspace for email, calendar, contacts and storage
...For personal information management, Kurrier syncs calendars via CalDAV and contacts via CardDAV, making it compatible with common clients across desktop and mobile ecosystems. It also adds an integrated “Drive” concept that can use WebDAV locally and is intended to support S3-compatible storage backends as the project expands. The UI aims to feel fast and cohesive across modules, with features like multiple identities (useful for multi-domain or multi-sender setups) and organizational tooling such as labels. -
8
Vector
A high-performance observability data pipeline
Vector is a Rust‑based, high‑performance observability data pipeline tool (agent + aggregator) designed to collect, transform, and route logs and metrics at scale. Created by Datadog, it aims to be the only tool needed from ingestion to vendor output, providing cost-efficient, safe, and flexible telemetry processing. -
9
PGHoard
PostgreSQL® backup and restore service
pghoard is a PostgreSQL backup and restore tool that provides encrypted, compressed, and cloud-optimized backups. Developed by Aiven, it supports streaming WAL archiving and full base backups to various cloud storage backends. pghoard is designed for reliability and fast disaster recovery in cloud-native PostgreSQL deployments. -
Compliant and Reliable File Transfers Backed by Top Security CertificationsStop relying on non-certified, legacy file transfer tools that creak under the weight of modern security demands. Get full audit trails, advanced access controls and more supported by an award-winning team of experts. Start your free 25-day trial today.
-
10
ESPectre
Motion detection system based on Wi-Fi spectre analysis (CSI)
ESPectre is an open-source motion detection system that transforms ordinary Wi-Fi signals into an ambient sensor capable of detecting movement without using cameras, microphones, or additional radio hardware, making it a privacy-preserving and cost-effective alternative for presence sensing and smart home automation. At its core, it analyzes Wi-Fi Channel State Information (CSI) — detailed measurements of how Wi-Fi waves change as they propagate — to mathematically detect disturbances caused... -
11
Longhorn
Cloud-Native distributed block storage for Kubernetes
Historically, adding replicated storage to Kubernetes clusters has always been difficult, thus resulting in many non-cloud-hosted Kubernetes clusters not supporting persistent storage. Longhorn is the solution to this. Longhorn provides highly available, persistent storage for Kubernetes. It is lightweight, simplified, reliable and powerful. It’s easy to deploy and upgrade, cloud-native and best of all, completely free and open source. Longhorn has built-in incremental snapshot and backup... -
12
OpenArchiver
An open-source platform for legally compliant email archiving
OpenArchiver is a comprehensive, self-hosted email archiving and compliance platform built to help organizations ingest, index, store, and search email communication data across diverse sources like Gmail, Microsoft 365, IMAP, PST, and more. It’s designed for scenarios where reliable, tamper-proof archiving and full-text search across both emails and attachments are essential for legal discovery, compliance, or long-term records retention. The platform combines a modern web UI with powerful... -
13
elFinder
Open-source file manager for web, written in JavaScript
...High-performance server backend and light client UI. Multi-root support. Local file system, MySQL, FTP, SFTP, Box, Dropbox, GoogleDrive and OneDrive volume storage drivers. Support AWS S3, Azure, Digital Ocean Spaces and more with League\Flysystem. Flysystem driver. Cloud storage (Box, Dropbox, GoogleDrive and OneDrive) drivers. Background file/folder upload with Drag & Drop HTML5 support. -
14
Postgres Operator
Postgres operator creates and manages PostgreSQL clusters
The Postgres Operator delivers easy-to-run highly available PostgreSQL clusters on Kubernetes (K8s) powered by Patroni. It is configured only through Postgres manifests (CRDs) to ease integration into automated CI/CD pipelines with no access to Kubernetes API directly, promoting infrastructure as code vs manual operations. -
15
SeaweedFS
Distributed storage system for blobs, objects, files, and data lake
SeaweedFS is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV. SeaweedFS is an independent Apache-licensed open source project with its ongoing development made possible because of the community. SeaweedFS is a simple and highly scalable distributed file system. There are two objectives, to store billions of files, and to serve the files fast! ... -
16
MinIO Operator
Simple Kubernetes Operator for MinIO clusters
MinIO is a Kubernetes-native high-performance object store with an S3-compatible API. The MinIO Kubernetes Operator supports deploying MinIO Tenants onto private and public cloud infrastructures ("Hybrid" Cloud). Each MinIO Tenant represents an independent MinIO Object Store within the Kubernetes cluster. The following diagram describes the architecture of a MinIO Tenant deployed into Kubernetes. The MinIO Console provides a graphical user interface (GUI) for interacting with MinIO Tenants. ... -
17
qryn
All-in-one Polyglot Observability stack with ClickHouse storage
All the greatest observability formats and integrations you love, at once - LGTM Drop-in compatible. Let's get Polyglot. qryn independently implements popular observability standards, protocols and query languages. Make sure you have sufficient memory and disk resources allocated for your node service and clickhouse server when dealing with large amounts of data and fingerprints. We suggest 8GB RAM or higher for most setups with 100k-1M fingerprints. Observe your daily and weekly data... -
18
Reposilite
Lightweight and easy-to-use repository management software
Lightweight and easy-to-use repository manager for Maven-based artifacts in JVM ecosystem. This is simple, extensible and scalable self-hosted solution to replace managers like Nexus, Archiva, or Artifactory, with reduced resource consumption. To run Reposilite for your personal needs you should assign around 20MB of RAM and at least Java 11+ installed. For huge public repositories, you can adjust the memory limit and even the size of used thread pools in the configuration. The recommended... -
19
SlateDB
A cloud native embedded storage engine built on object storage
Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage to provide bottomless storage capacity, high durability, and easy replication. SlateDB is an embedded storage engine built as a log-structured merge-tree. Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage (S3, GCS, ABS, MinIO, Tigris, and so on). Leveraging object storage allows SlateDB to provide bottomless storage capacity, high durability, and easy replication. The trade-off is that object storage has a higher latency and higher API cost than local disk. To mitigate high write API costs (PUTs), SlateDB batches writes. Rather than writing every put() call to object storage, MemTables are flushed periodically to object storage as a string-sorted table (SST). ... -
20
SDGym
Benchmarking synthetic data generation methods
The Synthetic Data Gym (SDGym) is a benchmarking framework for modeling and generating synthetic data. Measure performance and memory usage across different synthetic data modeling techniques – classical statistics, deep learning and more! The SDGym library integrates with the Synthetic Data Vault ecosystem. You can use any of its synthesizers, datasets or metrics for benchmarking. You also customize the process to include your own work. Select any of the publicly available datasets from the... -
21
XSIBackup-App
Backup and replicate Linux files, databases and ©VMWare ©ESXi VMs
...https://33hops.com/xsibackup-app-detailed-installation-instructions.html ©XSIBackup-App connects to multiple Linux or ©ESXi servers and backs VMs & files up to, local disk, NFS, iSCSI, Samba, etc... or to any Linux or ©ESXi server over IP, it just needs the SSH port open. This appliance is based in CentOS 7 and has root access. You can install any available software, including drivers for Amazon S3, Azure, Google Cloud, etc... We have improved speed with regards to the hypervisor service versions, mainly due to more flexible buffering. It follows the same principles and command line arguments as ©XSIBackup-DC. This new approach has many advantages over the software running directly in the Hypervisor OS, as it can backup an unlimited number of servers from a centralized console and you don't need to install anything in the Hypervisor OS -
22
Underscore Backup
Private, secure backups in the cloud.
Private, secure backups in the cloud of any size with minimal resource usage exactly the way you want them. Your data is encrypted by default using encryption keys only available to you and before leaving your network. Backed up data is signed to ensure protection from tampering. Data can be stored with any amount of redundancy and even multiple backup locations simultaneously. No information about the contents of your data is saved in any backup location. Only you can download and... -
23
Moved to GitHub: https://github.com/mitchcapper/KeePassSync KeePassSync is a KeePass plugin that synchronizes your database using various online storage providers. This allows two or more computers to easily keep their data in sync.
-
24
AWS Jupyter Proxy
Jupyter server extension to proxy requests with AWS SigV4 authentican
A Jupyter server extension to proxy requests with AWS SigV4 authentication. This server extension enables the usage of the AWS JavaScript/TypeScript SDK to write Jupyter frontend extensions without having to export AWS credentials to the browser. A single /awsproxy endpoint is added on the Jupyter server which receives incoming requests from the browser, uses the credentials on the server to add SigV4 authentication to the request, and then proxies the request to the actual AWS service... -
25
Database Backup Manager
Database backup manager for dumping to and restoring databases from S3
This package provides a framework-agnostic database backup manager for dumping to and restoring databases from S3, Dropbox, FTP, SFTP, and Rackspace Cloud. Backup the development database to Amazon S3. The S3 backup path will be test/backup.sql.gz in the end, when gzip is done with it. Once installed, the package must be bootstrapped (initial configuration) before it can be used. We recommend using the vagrant configuration supplied with this package for development and contribution. ...
