Search Results for "s3"
Sort By:
Showing 27 open source projects for "s3"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
MinIO Client Quickstart Guide
Fast tool to manage MinIO clusters
MinIO Client (mc) provides a modern alternative to UNIX commands like ls, cat, cp, mirror, diff, find etc. It supports filesystems and Amazon S3-compatible cloud storage service (AWS Signature v2 and v4). MinIO is distributed under GNU AGPLv3. See the source tree for complete information on all components of the work and their licenses. MinIO is a high-performance object storage solution that provides an Amazon Web Services S3-compatible API and supports all core S3 features. ... -
2
MinIO Go Client SDK
MinIO Go client SDK for S3 compatible object storage
The MinIO Go Client SDK provides simple APIs to access any Amazon S3-compatible object storage. This quickstart guide will show you how to install the MinIO client SDK, connect to MinIO, and provide a walkthrough for a simple file uploader. For a complete list of APIs and examples, please take a look at the Go Client API Reference. -
3
S5CMD
Parallel S3 and local filesystem execution tool
s5cmd is a very fast S3 and local filesystem execution tool. It comes with support for a multitude of operations including tab completion and wildcard support for files, which can be very handy for your object storage workflow while working with large number of files. There are already other utilities to work with S3 and similar object storage services, thus it is natural to wonder what s5cmd has to offer that others don't. s5cmd supports wide range of object management tasks both for cloud storage services and local filesystems. ... -
4
Zinc Search Engine
ZincSearch. A lightweight alternative to elasticsearch
...Docs coming soon. No need to work hard to define schema ahead of time. ZincSearch automatically discovers schema, so you can focus on search and analysis. Store data in S3 and MinIO for low cost, virtually infinite durable storage without the hassle of managing storage. -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
5
JuiceFS
JuiceFS is a distributed POSIX file system built on top of Redis
A POSIX, HDFS and S3 compatible distributed file system for cloud. JuiceFS is designed to bring back the gold-old memories and experience of file systems in local disks to the cloud. JuiceFS is POSIX compliant and is fully compatible with HDFS and S3. Cloud app building or migrating, file sharing cross-geo and cross-cloud has become easier than ever before. -
6
Apache Spark
A unified analytics engine for large-scale data processing
...The built-in MLlib library provides scalable machine learning algorithms, while GraphX enables graph computations integrated with data pipelines. Spark supports multiple languages—Scala, Java, Python, R—and connects with many storage systems like HDFS, S3, Cassandra, and streaming platforms like Kafka, making it a versatile choice for big data workloads in analytics, ETL, and data science. -
7
Cookiecutter Django
Framework for jumpstarting production-ready Django projects quickly
...Provides an optional basic ASGI setup for Websockets and an optional custom static build using Gulp and livereload. Send emails via Anymail (using Mailgun by default or Amazon SES if AWS is selected cloud provider, but switchable). Media storage using Amazon S3 or Google Cloud Storage. Docker support using docker-compose for development and production (using Traefik with LetsEncrypt support). Procfile for deploying to Heroku. Provides instructions for deploying to PythonAnywhere. You can run tests with unittest or pytest. -
8
GLAuth
A lightweight LDAP server for development, home use
...Centrally manage SSH keys, Linux accounts, and passwords for cloud servers. Lightweight alternative to OpenLDAP and Active Directory for development, or a homelab. Store your user directory in a file, local or in S3; SQL database; or proxy to existing LDAP servers. Two Factor Authentication (transparent to applications) Multiple backends can be chained to inject features. Use it to centralize account management across your Linux servers, your OSX machines, and your support applications (Jenkins, Apache/Nginx, Graylog2, and many more!). -
9
Argo Events
Event-driven Automation Framework for Kubernetes
...It allows you to trigger 10 different actions (such as the creation of Kubernetes objects, invoking workflows or serverless workloads) on over 20 different events (such as webhook, S3 drop, cron schedule, messaging queues - e.g. Kafka, GCP PubSub, SNS, SQS). -
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
10
AWS Chalice
Python Serverless Microframework for AWS
...You define routes, event handlers, and background tasks in plain Python, and Chalice turns them into AWS Lambda functions wired to API Gateway, Amazon EventBridge schedulers, S3/SNS/SQS triggers, and more. A single command builds your app, bundles dependencies, generates infrastructure templates, and deploys to your account with sensible defaults. The framework includes local development tools so you can iterate on HTTP routes and inspect logs before shipping to the cloud. It also manages per-stage configuration, environment variables, IAM permissions scaffolding, and packaging optimizations to keep cold starts small. ... -
11
Budibase
Create business apps and automate workflows in minutes
...You can also code against Budibase or fork it and make changes as you please, providing a developer-friendly experience. Budibase pulls data from multiple sources, including MongoDB, CouchDB, PostgreSQL, MariaDB, MySQL, Airtable, S3, DynamoDB, or a REST API. And unlike other platforms, with Budibase you can start from scratch and create business apps with no data sources. Request new data sources. -
12
Thanos
Highly available Prometheus setup with long term storage capabilities
...Scale your Prometheus setup by enabling querying of your Prometheus metrics across multiple Prometheus servers and clusters. Extend the system with the object storage of your choice to store your metrics for an unlimited time. Supports GCP, S3, Azure, Swift and Tencent COS. Use the same tools you love, such as Grafana and others, that support the Prometheus Query API. Downsample historical data for massive query speedup when querying large time ranges or configure complex retention policies. Thanos leverages the Prometheus 2.0 storage format to cost-efficiently store historical metric data in any object storage while retaining fast query latencies. ... -
13
Bref
Serverless PHP on AWS Lambda
Bref is an open-source serverless PHP framework designed to run PHP applications on AWS Lambda. It provides a simple way to deploy applications using serverless architecture, reducing costs and scaling automatically. Bref supports popular PHP frameworks and integrates seamlessly with AWS services, allowing developers to leverage the benefits of serverless without compromising on functionality. -
14
PHP-Casbin
An authorization library that supports access control models
...Besides memory and file, Casbin policy can be stored into lots of places. Currently, dozens of databases are supported, from MySQL, Postgres, Oracle to MongoDB, Redis, Cassandra, AWS S3. Check the full supported list at: adapters. Casbin is implemented in Golang, Java, PHP and Node.js. All implementations share the same API and behaviors. You can learn Casbin once and use it everywhere. -
15
Better Stack JavaScript client
Better Stack JavaScript client
...Formerly Logtail, lets you visualize your entire stack, turn your logs into structured data, and query everything like a single database with SQL. Customize retention per source to retain and query everything you want. No need to archive your logs to S3 anymore. Search all your logs anytime. See what metrics your teammates are looking at, comment on note-worthy data spikes and share log fragments with one click. Building a great software is a multiplayer game. Get answers fast with a powerful SQL query builder. No need to learn a new querying language or ask your data analyst. -
16
DreamFactory
DreamFactory API Management Platform
...Launch your project in weeks rather than months. DreamFactory instantly creates a secure, standardized, reusable, fully documented, and live REST API. Connect Salesforce to SQL Server, or your ERP to AWS S3. Transform and mask data along the way. Create reports, analytics, and alerts. Empower teams to retrieve and distribute data on demand. Secure every API endpoint behind Active Directory, OAuth2, Okta, OpenID Connect, and more. Restrict capabilities using role-Based Access Controls. Easily manage API keys. Deploy behind firewalls and in air-gapped environments. ... -
17
SQL Explorer
Easily share data across your company via SQL queries
SQL Explorer aims to make the flow of data between people fast, simple, and confusion-free. It is a Django-based application that you can add to an existing Django site, or use as a standalone business intelligence tool. Quickly write and share SQL queries in a simple, usable SQL editor, preview the results in the browser, share links, download CSV, JSON, or Excel files (and even expose queries as API endpoints, if desired), and keep the information flowing! Comes with support for multiple... -
18
Kedro
A Python framework for creating reproducible, maintainable code
Kedro is an open sourced Python framework for creating maintainable and modular data science code. Provides the scaffolding to build more complex data and machine-learning pipelines. In addition, there's a focus on spending less time on the tedious "plumbing" required to maintain data science code; this means that you have more time to solve new problems. Standardises team workflows; the modular structure of Kedro facilitates a higher level of collaboration when teams solve problems... -
19
Voyage
Voyager - The Missing Laravel Admin
...Voyager has a fully functional media manager which allows you to view/edit/delete files from your storage. All files in your application will be easily accessible and will live in a single place. Compatible with local or s3 file storage. You can easily build menus for your site. In fact the menu in the Voyager admin is built using the menu builder. You can add/edit/delete menu items from any menu. Then it's so easy to show your menu on the front end. -
20
Terraboard
A web dashboard to inspect Terraform States
A Web dashboard to inspect and query Terraform states. Terraboard gets its data from versioned S3 buckets and DynamoDB databases. Ever wondered in which Terraform project your resources are managed? Terraboard’s search interface helps you answer that! The dashboard features charts with useful stats on your Terraform resources. Terraboard comes packaged as a small container, making it fast and easy to deploy on all container platforms. -
21
Wink
A Laravel-based publishing platform
...You can add photos, code blocks, featured images, social media & SEO attributes, embedded HTML (YouTube Videos, Embedded Podcasts Episodes, Tweets, ...), and markdown. If you want to upload images to S3, update the storage_disk attribute in your wink.php configuration file to s3. Make sure your S3 disk is correctly configured in your filesystems.php configuration file. -
22
Electron Release Server
A fully featured, self-hosted release server for electron applications
...Awesome release management interface powered by AngularJS. Authenticates with LDAP, easy to modify to another authentication method if needed. Store assets on server disk, or Amazon S3 (with minor modifications). Use pretty much any database for persistence, thanks to Sails & Waterline. Simple but powerful download urls (NOTE: when no assets are uploaded, server returns 404 by default). -
23
Apache MXNet (incubating)
A flexible and efficient library for deep learning
Apache MXNet is an open source deep learning framework designed for efficient and flexible research prototyping and production. It contains a dynamic dependency scheduler that automatically parallelizes both symbolic and imperative operations. On top of this is a graph optimization layer, overall making MXNet highly efficient yet still portable, lightweight and scalable. -
24
Rome
Carthage cache for S3, Minio, Ceph, Google Storage, Artifactory, etc.
Carthage cache for S3, Minio, Ceph, Google Storage, Artifactory and many others. Rome is a tool that allows developers on Apple platforms to use Amazon's S3, Minio, Ceph, other S3-compatible object stores or/and a local folder. The Rome binary is also attached as a zip to each release on the releases page here on GitHub. Suppose you're working a number of frameworks for your project and want to share those with your team. -
25
GoSpider
Gospider - Fast web spider written in Go
GoSpider - Fast web spider written in Go. Fast web crawling. Brute force and parse sitemap.xml. Parse robots.txt. Generate and verify link from JavaScript files. Link Finder. Find AWS-S3 from response source. Find subdomains from the response source. Get URLs from Wayback Machine, Common Crawl, Virus Total, Alien Vault. Format output easy to Grep. Support Burp input. Crawl multiple sites in parallel.
