Search Results for "s3"
Sort By:
Showing 103 open source projects for "s3"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
Earn up to 16% annual interest with Nexo.Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.
-
1
MinIO
High performance object storage server compatible with Amazon S3 APIs
MinIO is a high performance object storage server that is API compatible with Amazon S3 cloud storage service. MinIO makes it easy to build high performance, cloud native data infrastructure for machine learning, analytics and application data workloads. It is incredibly fast, enabling object storage to operate as the primary storage tier for a diverse set of workloads. It is also built to be cloud native and enterprise ready. -
2
MinIO Client Quickstart Guide
Fast tool to manage MinIO clusters
MinIO Client (mc) provides a modern alternative to UNIX commands like ls, cat, cp, mirror, diff, find etc. It supports filesystems and Amazon S3-compatible cloud storage service (AWS Signature v2 and v4). MinIO is distributed under GNU AGPLv3. See the source tree for complete information on all components of the work and their licenses. MinIO is a high-performance object storage solution that provides an Amazon Web Services S3-compatible API and supports all core S3 features. ... -
3
AWS SDK for PHP
Repository of the AWS SDK for PHP
The AWS SDK for PHP makes it easy for developers to access Amazon Web Services in their PHP code, and build robust applications and software using services like Amazon S3, Amazon DynamoDB, Amazon Glacier, etc. You can get started in minutes by installing the SDK through Composer or by downloading a single zip or phar file from our latest release. Before you begin, you need to sign up for an AWS account and retrieve your AWS credentials. To run the SDK, your system will need to meet the minimum requirements, including having PHP >= 5.5. ... -
4
S3Mock
A simple mock implementation of the AWS S3 API startable as Docker
S3Mock is a lightweight server that implements parts of the Amazon S3 API. It has been created to support local integration testing by reducing infrastructure dependencies. The S3Mock server can be started as a standalone Docker container, using Test containers, JUnit4, JUnit5 and TestNG support, or programmatically. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
5
MinIO Go Client SDK
MinIO Go client SDK for S3 compatible object storage
The MinIO Go Client SDK provides simple APIs to access any Amazon S3-compatible object storage. This quickstart guide will show you how to install the MinIO client SDK, connect to MinIO, and provide a walkthrough for a simple file uploader. For a complete list of APIs and examples, please take a look at the Go Client API Reference. -
6
S3Proxy
S3Proxy implements the S3 API and proxies requests
S3Proxy implements the S3 API and proxies requests, enabling several use cases. Translation from S3 to Backblaze B2, EMC Atmos, Google Cloud, Microsoft Azure, and OpenStack Swift. Testing without Amazon by using the local filesystem. Extension via middleware. Embedding into Java applications. Docker Hub hosts a Docker image and has instructions on how to run it. -
7
SFTPGo
Fully featured and highly configurable SFTP server with optional HTTP
Fully featured and highly configurable SFTP server with optional HTTP/S, FTP/S and WebDAV support. Several storage backends are supported: local filesystem, encrypted local filesystem, S3 (compatible) Object Storage, Google Cloud Storage, Azure Blob Storage, SFTP. SFTPGo is an Open Source project and you can of course use it for free but please don't ask for free support as well. Support for serving local filesystem, encrypted local filesystem, S3 Compatible Object Storage, Google Cloud Storage, Azure Blob Storage or other SFTP accounts over SFTP/SCP/FTP/WebDAV. ... -
8
S5CMD
Parallel S3 and local filesystem execution tool
s5cmd is a very fast S3 and local filesystem execution tool. It comes with support for a multitude of operations including tab completion and wildcard support for files, which can be very handy for your object storage workflow while working with large number of files. There are already other utilities to work with S3 and similar object storage services, thus it is natural to wonder what s5cmd has to offer that others don't. s5cmd supports wide range of object management tasks both for cloud storage services and local filesystems. ... -
9
SageMaker TensorFlow Training Toolkit
Toolkit for running TensorFlow training scripts on SageMaker
...After creating a SageMaker Model, you can use it to create SageMaker Batch Transform Jobs for offline inference, or create SageMaker Endpoints for real-time inference. A SageMaker Model contains references to a model.tar.gz file in S3 containing serialized model data, and a Docker image used to serve predictions with that model. A Batch Transform job runs an offline-inference job using your TensorFlow Serving model. Input data in S3 is converted to HTTP requests, and responses are saved to an output bucket in S3. -
Host LLMs in Production With On-Demand GPUsDeploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.
-
10
CubeFS
cloud-native file store
CubeFS is a new generation cloud-native storage that supports access protocols such as S3, HDFS, and POSIX. It is widely applicable in various scenarios such as big data, AI/LLMs, container platforms, separation of storage and computing for databases and middleware, data sharing and protection, etc. Compatible with various access protocols such as S3, POSIX, HDFS, etc., and the access between protocols can be interoperable. -
11
Zinc Search Engine
ZincSearch. A lightweight alternative to elasticsearch
...Docs coming soon. No need to work hard to define schema ahead of time. ZincSearch automatically discovers schema, so you can focus on search and analysis. Store data in S3 and MinIO for low cost, virtually infinite durable storage without the hassle of managing storage. -
12
AWS SDK ZF2 Module
ZF2 module for using the AWS SDK for PHP to interact with AWS services
...Remove the session state scale bottleneck by easily storing the application session state in DynamoDB. Use PHP's built-in functions such as fopen, copy, and file_get_contents to work with objects stored in Amazon S3. Automates polling for resource state changes such as waiting for a newly launched Amazon EC2 instance to reach the 'running' state. -
13
Amazon Braket Python Schemas
A library that contains schemas for Amazon Braket
Amazon Braket Python Schemas is an open source library that contains the schemas for Braket, including intermediate representations (IR) for Amazon Braket quantum tasks and offers serialization and deserialization of those IR payloads. Think of the IR as the contract between the Amazon Braket SDK and Amazon Braket API for quantum programs. Schemas for the S3 results of each quantum task. Schemas for the device capabilities of each device. The preferred way to get Amazon Braket Python Schemas is by installing the Amazon Braket Python SDK, which will pull in the schemas. You can install from source by cloning this repository and running a pip install command in the root directory of the repository. ... -
14
JuiceFS
JuiceFS is a distributed POSIX file system built on top of Redis
A POSIX, HDFS and S3 compatible distributed file system for cloud. JuiceFS is designed to bring back the gold-old memories and experience of file systems in local disks to the cloud. JuiceFS is POSIX compliant and is fully compatible with HDFS and S3. Cloud app building or migrating, file sharing cross-geo and cross-cloud has become easier than ever before. -
15
Dropzone
Drag'n'drop library, supports image previews and shows progress bars
...Multiple files can be processed together, and large files can be divided into smaller chunks for more reliable transfer. Image uploads can generate thumbnails and resize images in the browser before transmission. The library also supports Amazon S3 multipart upload workflows. Developers can replace default event handlers and styling to fully customize appearance and behavior. Version 6 ships its own TypeScript definitions and is maintained in a monorepo containing the library, documentation, website, tests, and examples. -
16
AWS SDK for Go v2
AWS SDK for the Go programming language
...The AWS SDK for Go V2 provides APIs and utilities that developers can use to build Go applications that use AWS services, such as Amazon Elastic Compute Cloud (Amazon EC2) and Amazon Simple Storage Service (Amazon S3). The SDK removes the complexity of coding directly against a web service interface. It hides a lot of the lower-level plumbing, such as authentication, request retries, and error handling. The SDK also includes helpful utilities. For example, the Amazon S3 download and upload manager can automatically break up large objects into multiple parts and transfer them in parallel. ... -
17
DVC
Data Version Control | Git for Data & Models
...It is designed to handle large files, data sets, machine learning models, and metrics as well as code. Version control machine learning models, data sets and intermediate files. DVC connects them with code and uses Amazon S3, Microsoft Azure Blob Storage, Google Drive, Google Cloud Storage, Aliyun OSS, SSH/SFTP, HDFS, HTTP, network-attached storage, or disc to store file contents. Version control machine learning models, data sets, and intermediate files. DVC connects them with code and uses Amazon S3, Microsoft Azure Blob Storage, Google Drive, Google Cloud Storage, Aliyun OSS, SSH/SFTP, HDFS, HTTP, network-attached storage, or disc to store file contents. ... -
18
Apache Spark
A unified analytics engine for large-scale data processing
...The built-in MLlib library provides scalable machine learning algorithms, while GraphX enables graph computations integrated with data pipelines. Spark supports multiple languages—Scala, Java, Python, R—and connects with many storage systems like HDFS, S3, Cassandra, and streaming platforms like Kafka, making it a versatile choice for big data workloads in analytics, ETL, and data science. -
19
AWS Toolkit for JetBrains
A plugin for interacting with AWS from JetBrains IDEs
The AWS Toolkit for JetBrains makes it easier to write applications built on Amazon Web Services. If you come across bugs with the toolkit or have feature requests, please raise an issue on our GitHub repository. See the user guide for how to get started, along with what features/services are supported. CodeWhisperer uses machine learning to generate code suggestions from the existing code and comments in your IDE. Supported languages include: Java, Python, and JavaScript. In addition to... -
20
AWS Lambda for .NET
Libraries, samples and tools to help .NET Core developers
AWS Lambda for .NET is the repository that houses tools, libraries and templates to build and deploy AWS Lambda functions using the .NET ecosystem (including .NET Core and .NET 7+). It provides NuGet packages for event models (e.g., API Gateway, DynamoDB, S3), utilities such as Amazon.Lambda.Tools for CLI deployment, and Blueprints/templates to scaffold serverless .NET projects quickly. The framework supports writing functions in C# (and VB/F# where applicable), integrates with the .NET CLI and Visual Studio tooling, and allows developers to treat Lambda functions like any other managed .NET application while handling the deployment, packaging and runtime glue. ... -
21
walgit
A git server that is one binary in front of an object store
walgit is a lightweight Git server designed around object storage rather than traditional server-local repository state. A single binary can host repositories whose durable data resides in S3-compatible storage or Google Cloud Storage. It supports standard Git fetch and push operations over Smart HTTP, including protocol versions 0 and 2. Bundle-based cloning and Git LFS are included for handling repositories and large files efficiently. Users also get a repository browsing interface, JSON API, SDK, webhooks, and configurable push policies. ... -
22
GLAuth
A lightweight LDAP server for development, home use
...Centrally manage SSH keys, Linux accounts, and passwords for cloud servers. Lightweight alternative to OpenLDAP and Active Directory for development, or a homelab. Store your user directory in a file, local or in S3; SQL database; or proxy to existing LDAP servers. Two Factor Authentication (transparent to applications) Multiple backends can be chained to inject features. Use it to centralize account management across your Linux servers, your OSX machines, and your support applications (Jenkins, Apache/Nginx, Graylog2, and many more!). -
23
Cookiecutter Django
Framework for jumpstarting production-ready Django projects quickly
...Provides an optional basic ASGI setup for Websockets and an optional custom static build using Gulp and livereload. Send emails via Anymail (using Mailgun by default or Amazon SES if AWS is selected cloud provider, but switchable). Media storage using Amazon S3 or Google Cloud Storage. Docker support using docker-compose for development and production (using Traefik with LetsEncrypt support). Procfile for deploying to Heroku. Provides instructions for deploying to PythonAnywhere. You can run tests with unittest or pytest. -
24
CTFd
CTFs as you need them
...Challenge plugin architecture to create your own custom challenges. Static & Regex-based flags. Custom flag plugins. Unlockable hints. File uploads to the server or an Amazon S3-compatible backend. Limit challenge attempts & hide challenges. Automatic bruteforce protection. Individual and Team-based competitions. Have users play on their own or form teams to play together. Scoreboard with automatic tie resolution. Hide Scores from the public. Freeze Scores at a specific time. Scoregraphs comparing the top 10 teams and team progress graphs. ... -
25
Argo Events
Event-driven Automation Framework for Kubernetes
...It allows you to trigger 10 different actions (such as the creation of Kubernetes objects, invoking workflows or serverless workloads) on over 20 different events (such as webhook, S3 drop, cron schedule, messaging queues - e.g. Kafka, GCP PubSub, SNS, SQS).
