Search Results for "distributed file" - Page 2
Sort By:
Showing 437 open source projects for "distributed file"
View related business solutions-
Free CRM Software With Something for EveryoneThink CRM software is just about contact management? Think again. HubSpot CRM has free tools for everyone on your team, and it’s 100% free. Here’s how our free CRM solution makes your job easier.
-
Save hundreds of developer hours with components built for SaaS applications.Whether you want full self-service analytics or simpler multi-tenant security, Qrvey’s embeddable components and scalable data management remove the guess work.
-
1
Colossal-AI
Making large AI models cheaper, faster and more accessible
The Transformer architecture has improved the performance of deep learning models in domains such as Computer Vision and Natural Language Processing. Together with better performance come larger model sizes. This imposes challenges to the memory wall of the current accelerator hardware such as GPU. It is never ideal to train large models such as Vision Transformer, BERT, and GPT on a single GPU or a single machine. There is an urgent demand to train models in a distributed environment. However... -
2
Azure SDK for Python
Active development of the Azure SDK for Python
This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs or our versioned developer docs. For your convenience, each service has a separate set of libraries that you can choose to use instead of one, large Azure package. To get started with a specific library, see the README.md (or README.rst) file located in the library's project folder. Last stable versions of packages that have been provided for usage... -
3
ipwb
A distributed and persistent archive replay system using IPFS
InterPlanetary Wayback (ipwb) facilitates permanence and collaboration in web archives by disseminating the contents of WARC files into the IPFS network. IPFS is a peer-to-peer content-addressable file system that inherently allows deduplication and facilitates opt-in replication. ipwb splits the header and payload of WARC response records before disseminating into IPFS to leverage the deduplication, builds a CDXJ index with references to the IPFS hashes returned, and combines the header... -
4
go-fastdfs
Go-fastdfs is a simple distributed file system
Provide users with the simplest, reliable and efficient distributed file system. There are many open source distributed files and powerful functions. Solve the complex problems of software architecture. Solve the problem of deployment and maintenance of Yunwei. Solve the complex problem of use. go-fastdfs is a distributed file system based on the http protocol. It is based on the design concept of avenue to simplicity. Everything is simple to design, making its operation and expansion easier... -
Deliver secure remote access with OpenVPN.OpenVPN's products provide scalable, secure remote access — giving complete freedom to your employees to work outside the office while securely accessing SaaS, the internet, and company resources.
-
5
Shiori
Simple bookmark manager built with Go
Shiori is a simple bookmarks manager written in the Go language. Intended as a simple clone of Pocket. You can use it as a command line application or as a web application. This application is distributed as a single binary, which means it can be installed and used easily. Basic bookmarks management i.e. add, edit, delete and search. Import and export bookmarks from and to Netscape Bookmark file. Import bookmarks from Pocket. Simple and clean command line interface. Simple and pretty web... -
6
Redoc
OpenAPI/Swagger-generated API Reference Documentation
Redoc is an open source tool for generating documentation from OpenAPI (formerly Swagger) definitions. With Redoc, you can generate beautiful API documentation from OpenAPI. Redoc is provided as a CLI tool (also distributed as a Docker image), HTML tag, and React component. If you have Node installed, quickly generate documentation using npx. Open the HTML file in your browser, and your API documentation is shown on the page. Redoc is highly configurable. Redoc offers OpenAPI specification... -
7
jstree
jquery tree plugin
jsTree is jquery plugin, that provides interactive trees. It is absolutely free, open-source and distributed under the MIT license. jsTree is easily extendable, themable and configurable, it supports HTML & JSON data sources and AJAX loading. jsTree functions properly in either box-model (content-box or border-box), can be loaded as an AMD module, and has a built in mobile theme for responsive design, that can easily be customized. It uses jQuery's event system, so binding callbacks on various... -
8
PLEX
Plex Lab Exchange. Client for running scientific workflows
Build highly reproducible container workflows on top of a decentralized computing network. PLEX is using distributed computing and storage to run containers on a public network. Need GPUs? We got you covered. Every tool in PLEX has declared inputs and outputs. Plugging together tools by other authors should be easy. Every file processed by PLEX has a deterministic address based on its content. Keep track of your files and always share the right results with other scientists. PLEX is a simple... -
9
Zinnia
Runtime for worker nodes executing modules
Zinnia is a runtime for Filecoin Station modules. It provides a sandboxed environment to execute untrusted code on consumer-grade computers. Zinnia is a sandboxed and resource-limited runtime for distributed workers. This crate provides the zinnia executable to run modules locally, e.g. while developing. -
Red Hat Enterprise Linux on Microsoft AzureRed Hat Enterprise Linux (RHEL) on Microsoft Azure provides a secure, reliable, and flexible foundation for your cloud infrastructure. Red Hat Enterprise Linux on Microsoft Azure is ideal for enterprises seeking to enhance their cloud environment with seamless integration, consistent performance, and comprehensive support.
-
10
IPFS Cluster
Pinset orchestration for IPFS
IPFS Cluster provides data orchestration across a swarm of IPFS daemons by allocating, replicating and tracking a global pinset distributed among multiple peers. IPFS has given the users the power of content-addressed storage. The permanent web requires, however, a data redundancy and availability solution that does not compromise on the distributed nature of the IPFS Network. IPFS Cluster is a distributed application that works as a sidecar to IPFS peers, maintaining a global cluster pinset... -
11
DeepFlow
Application Observability using eBPF
... in any language and infrastructures including gateways, service meshes, databases, message queues, DNS, and NICs, leaving no blind spots. Full-stack network performance metrics and file I/O events are automatically collected for each Span. Distributed tracing enters a new era, Zero Instrumentation. DeepFlow collects profiling data at a cost of below 1% with Zero Code, plots OnCPU/OffCPU function call stack flame graphs, and locates Full Stack performance bottleneck in the application. -
12
Go Micro
A framework for distributed systems development
Go Micro is a framework for distributed systems development. Go Micro provides the core requirements for distributed systems development including RPC and Event driven communication. The Micro philosophy is sane defaults with a pluggable architecture. We provide defaults to get you started quickly but everything can be easily swapped out. Auth is built in as a first class citizen. Authentication and authorization enable secure zero trust networking by providing every service an identity... -
13
FileTrees.jl
Parallel file processing made easy
... is running with. Files and subtrees in a file tree can have any value attached to them, you can map and reduce over these values, or combine them by merging or collapsing trees or subtrees. When computing lazy trees, these values are held in distributed memory and operated on in parallel. -
14
FileDAG Storage
A distributed storage service built on the IPFS technology stack
FileDAG Storage A distributed storage service built on the IPFS technology stack. Different from the official implementation of IPFS, we focus more on data management, data reliability, availability and fault tolerance, and clustering of storage nodes. The minimum storage unit of FileDAG Storage is dag, which is the data block. Files or objects are organized in a merkle-dag structure, and multiple files or objects may share some data blocks. The obvious benefit of this is to reduce redundant... -
15
go-orbit-db
Go version of P2P Database on IPFS
orbit-db is a distributed peer-to-peer database on IPFS. This project intends to provide a fully compatible port of the JavaScript version in Go. The majority of this code was vastly derived from JavaScript's orbit-db project. -
16
JuiceFS
JuiceFS is a distributed POSIX file system built on top of Redis
A POSIX, HDFS and S3 compatible distributed file system for cloud. JuiceFS is designed to bring back the gold-old memories and experience of file systems in local disks to the cloud. JuiceFS is POSIX compliant and is fully compatible with HDFS and S3. Cloud app building or migrating, file sharing cross-geo and cross-cloud has become easier than ever before. Whether it's a public cloud, private cloud, or hybrid cloud, JuiceFS is available on any cloud of your choice and delivers flexibility... -
17
Curve
Curve is a sandbox project hosted by the CNCF Foundation
A cloud-native distributed storage system. A sandbox project hosted by the CNCF Foundation. Curve is a modern storage system developed by netease, currently supporting file storage(CurveFS) and block storage(CurveBS). Now it's hosted at CNCF as a sandbox project. The performance, mixed, capacity cloud disk or persistent volume of virtual machine/container, and remote disks of physical machines. High-performance separation of storage and computation architecture: high-performance and low latency... -
18
Diffuse
A music player that connects to your cloud/distributed storage
A music player that connects to your cloud/distributed storage, in the form of a static, serverless, web application. Diffuse is a static web application, which means it's just HTML, CSS, and Javascript. No REST API, database, or anything backend-related is involved. The app uses a hash (aka. fragment-based) routing system, so you don't need any special server rules for routing. You can download a pre-build web-only version of Diffuse on the releases page. Diffuse uses service workers, so you... -
19
go-ipfs-log
Go version of append-only log CRDT on IPFS
Go version of append-only log CRDT on IPFS. An append-only log on IPFS. ipfs-log was originally created for orbit-db - a distributed peer-to-peer database on IPFS. This library intends to provide a fully compatible port of the JavaScript version in Go. The majority of this code was vastly derived from JavaScript's ipfs-log library. -
20
Summa
Full-text IPFS-friendly and WASM-compatible Search in Rust
Summa is a full-text IPFS-friendly search engine that may be launched on both large servers and inside your browser. Thanks to the embedded IPFS daemon, your data can be replicated and published through P2P, allowing for a truly distributed and uncensorable search experience. And, thanks to compatibility with WASM, Summa can be launched entirely inside your browser, enabling you to search in network-published indices without ever having to execute search queries on remote servers. -
21
Roslynator
A collection of 500+ analyzers, refactorings and fixes for C#
A collection of 500+ analyzers, refactorings, and fixes for C#, powered by Roslyn. Roslynator client libraries are meant to be used for the development of your own analyzers/refactorings. It does not contain any analyzers/refactorings themselves. All analyzers in package Roslynator.Formatting.Analyzers are disabled by default. Roslynator Testing Framework can be used for unit testing of analyzers, refactorings and code fix. The framework is distributed as a NuGet package. Some analyzers require... -
22
mgmt
Next generation distributed, event-driven, parallel config management!
Mgmt is a real-time automation tool. It is familiar to existing configuration management software but is drastically more powerful as it can allow you to build real-time, closed-loop feedback systems, in a very safe way, and with a surprisingly small amount of our mcl code. For example, the following code will ensure that your file server is set to read-only when it's Friday. It can run continuously, intermittently, or on demand, and in the first case, it will guarantee that your system... -
23
Rakudo
Rakudo – Raku on MoarVM, JVM, and JS
This is Rakudo, a Raku Programming Language compiler for the MoarVM, JVM, and Javascript virtual machines. Rakudo is distributed under the terms of the Artistic License 2.0. For more details, see the full text of the license in the file LICENSE. This directory contains only the Rakudo compiler itself; it does not contain any of the modules, documentation, or other items that would normally come with a full Raku distribution. If you're after more than just the bare compiler, please download... -
24
Rook
Storage Orchestration for Kubernetes
Rook turns distributed storage systems into self-managing, self-scaling, self-healing storage services. It automates the tasks of a storage administrator: deployment, bootstrapping, configuration, provisioning, scaling, upgrading, migration, disaster recovery, monitoring, and resource management. Rook orchestrates the Ceph storage solution, with a specialized Kubernetes Operator to automate management. Rook ensures that Ceph will run well on Kubernetes and simplify the deployment and management... -
25
Project Lotus
Reference implementation of the Filecoin protocol, written in Go
Lotus is the reference implementation for the Filecoin network. It is written in Go, and is maintained by the Protocol Labs team. This website contains all the information you need to spin up a Lotus node, become a Filecoin storage provider, or just tinker around with the Filecoin network! Filecoin is a network of computers that allows you to store your data online. But while online storage services aren't anything new, Filecoin is different. It doesn't use centralized servers to store your...