Search Results for "distributed file"
Sort By:
Showing 30 open source projects for "distributed file"
View related business solutions-
HubSpot is an AI-powered customer platform with all the software, integrations, and resources you need to connect your marketing, sales, and customer service. HubSpot's connected platform enables you to grow your business faster by focusing on what matters most: your customers.
-
Think CRM software is just about contact management? Think again. HubSpot CRM has free tools for everyone on your team, and it’s 100% free. Here’s how our free CRM solution makes your job easier.
-
1
Project Lotus
Reference implementation of the Filecoin protocol, written in Go
Lotus is the reference implementation for the Filecoin network. It is written in Go, and is maintained by the Protocol Labs team. This website contains all the information you need to spin up a Lotus node, become a Filecoin storage provider, or just tinker around with the Filecoin network! Filecoin is a network of computers that allows you to store your data online. But while online storage services aren't anything new, Filecoin is different. It doesn't use centralized servers to store your... -
2
Hyprspace
A Lightweight VPN Built on top of IPFS + Libp2p
A Lightweight VPN Built on top of IPFS & Libp2p. Libp2p is a networking library created by Protocol Labs that allows nodes to discover each other using a Distributed Hash Table. Paired with NAT hole punching this allows Hyprspace to create a direct encrypted tunnel between two nodes even if they're both behind firewalls. Moreover! Each node doesn't even need to know the other's ip address prior to starting up the connection. This makes Hyprspace perfect for devices that frequently migrate... -
3
go-fastdfs
Go-fastdfs is a simple distributed file system
Provide users with the simplest, reliable and efficient distributed file system. There are many open source distributed files and powerful functions. Solve the complex problems of software architecture. Solve the problem of deployment and maintenance of Yunwei. Solve the complex problem of use. go-fastdfs is a distributed file system based on the http protocol. It is based on the design concept of avenue to simplicity. Everything is simple to design, making its operation and expansion easier... -
4
PLEX
Plex Lab Exchange. Client for running scientific workflows
Build highly reproducible container workflows on top of a decentralized computing network. PLEX is using distributed computing and storage to run containers on a public network. Need GPUs? We got you covered. Every tool in PLEX has declared inputs and outputs. Plugging together tools by other authors should be easy. Every file processed by PLEX has a deterministic address based on its content. Keep track of your files and always share the right results with other scientists. PLEX is a simple... -
For minor company expenses, you might utilize a spend management solution or track everything in spreadsheets. For everything more, you'll need Precoro. We help companies achieve procurement excellence and budget efficiency by building transparent, predictable, automated spending workflows.
-
5
IPFS Cluster
Pinset orchestration for IPFS
IPFS Cluster provides data orchestration across a swarm of IPFS daemons by allocating, replicating and tracking a global pinset distributed among multiple peers. IPFS has given the users the power of content-addressed storage. The permanent web requires, however, a data redundancy and availability solution that does not compromise on the distributed nature of the IPFS Network. IPFS Cluster is a distributed application that works as a sidecar to IPFS peers, maintaining a global cluster pinset... -
6
Wesh Network Toolkit
Async Mesh Network Protocol for Extreme Communication
With Wesh's toolkit, building p2p apps has never been simpler. Wesh network is a decentralized extreme communication protocol. Wesh provides a secured, distributed and asynchronous communication protocol, both with or without internet access using IPFS and direct transports such as BLE and proximity drivers. Wesh Protocol provides end-to-end encryption and perfect forward secrecy for all the exchanged messages. Distributed p2p transmissions and hosting over IPFS powered by CRDT algorithm... -
7
DeepFlow
Application Observability using eBPF
... in any language and infrastructures including gateways, service meshes, databases, message queues, DNS, and NICs, leaving no blind spots. Full-stack network performance metrics and file I/O events are automatically collected for each Span. Distributed tracing enters a new era, Zero Instrumentation. DeepFlow collects profiling data at a cost of below 1% with Zero Code, plots OnCPU/OffCPU function call stack flame graphs, and locates Full Stack performance bottleneck in the application. -
8
CubeFS
cloud-native file store
... according to business scenarios. Easy to build a PB or EB-scale distributed storage service, and each module can be expanded horizontally. Supports multi-tenant management and provides fine-grained tenant isolation policies. Supports multi-level caching, and multiple high-performance replication protocols, and optimizes specific performance for small files. -
9
SeaweedFS
Distributed storage system for blobs, objects, files, and data lake
... and highly scalable distributed file system. There are two objectives, to store billions of files, and to serve the files fast! SeaweedFS started as an Object Store to handle small files efficiently. Instead of managing all file metadata in a central master, the central master only manages volumes on volume servers, and these volume servers manage files and their metadata. -
With the world of work changed forever, it’s essential to manage your workplace and assets together to effectively create a high-performing environment. The Eptura experience combines the power of workplace management software with asset management, enabling you to effectively operate your building and facilitate hybrid work.
-
10
Go Micro
A framework for distributed systems development
Go Micro is a framework for distributed systems development. Go Micro provides the core requirements for distributed systems development including RPC and Event driven communication. The Micro philosophy is sane defaults with a pluggable architecture. We provide defaults to get you started quickly but everything can be easily swapped out. Auth is built in as a first class citizen. Authentication and authorization enable secure zero trust networking by providing every service an identity... -
11
FileDAG Storage
A distributed storage service built on the IPFS technology stack
FileDAG Storage A distributed storage service built on the IPFS technology stack. Different from the official implementation of IPFS, we focus more on data management, data reliability, availability and fault tolerance, and clustering of storage nodes. The minimum storage unit of FileDAG Storage is dag, which is the data block. Files or objects are organized in a merkle-dag structure, and multiple files or objects may share some data blocks. The obvious benefit of this is to reduce redundant... -
12
go-orbit-db
Go version of P2P Database on IPFS
orbit-db is a distributed peer-to-peer database on IPFS. This project intends to provide a fully compatible port of the JavaScript version in Go. The majority of this code was vastly derived from JavaScript's orbit-db project. -
13
JuiceFS
JuiceFS is a distributed POSIX file system built on top of Redis
A POSIX, HDFS and S3 compatible distributed file system for cloud. JuiceFS is designed to bring back the gold-old memories and experience of file systems in local disks to the cloud. JuiceFS is POSIX compliant and is fully compatible with HDFS and S3. Cloud app building or migrating, file sharing cross-geo and cross-cloud has become easier than ever before. Whether it's a public cloud, private cloud, or hybrid cloud, JuiceFS is available on any cloud of your choice and delivers flexibility... -
14
DTail
DTail is a distributed DevOps tool for tailing, grepping, catting logs
DTail (a distributed tail program) is a DevOps tool for engineers programmed in Google Go for following (tailing), catting and grepping (including gzip and zstd decompression support) log files on many machines concurrently. An advanced feature of DTail is to execute distributed MapReduce aggregations across many devices. For secure authorization and transport encryption, the SSH protocol is used. Furthermore, DTail respects the UNIX file system permission model (traditional on all Linux/UNIX... -
15
Chanify
Chanify is a safe and simple notification tools
Chanify is a safe and simple notification tools. For developers, system administrators, and everyone can push notifications with API. -
16
go-ipfs-log
Go version of append-only log CRDT on IPFS
Go version of append-only log CRDT on IPFS. An append-only log on IPFS. ipfs-log was originally created for orbit-db - a distributed peer-to-peer database on IPFS. This library intends to provide a fully compatible port of the JavaScript version in Go. The majority of this code was vastly derived from JavaScript's ipfs-log library. -
17
mgmt
Next generation distributed, event-driven, parallel config management!
Mgmt is a real-time automation tool. It is familiar to existing configuration management software but is drastically more powerful as it can allow you to build real-time, closed-loop feedback systems, in a very safe way, and with a surprisingly small amount of our mcl code. For example, the following code will ensure that your file server is set to read-only when it's Friday. It can run continuously, intermittently, or on demand, and in the first case, it will guarantee that your system... -
18
Rook
Storage Orchestration for Kubernetes
Rook turns distributed storage systems into self-managing, self-scaling, self-healing storage services. It automates the tasks of a storage administrator: deployment, bootstrapping, configuration, provisioning, scaling, upgrading, migration, disaster recovery, monitoring, and resource management. Rook orchestrates the Ceph storage solution, with a specialized Kubernetes Operator to automate management. Rook ensures that Ceph will run well on Kubernetes and simplify the deployment and management... -
19
Reproxy
Simple edge server / reverse proxy
Reproxy is a simple edge HTTP(s) server / reverse proxy supporting various providers (docker, static, file, consul catalog). One or more providers supply information about the requested server, requested URL, destination URL, and health check URL. It is distributed as a single binary or as a docker container. Both HTTP and HTTPS are supported. For HTTPS, static certificates can be used as well as automated ACME (Let’s Encrypt) certificates. An optional assets server can be used to serve static... -
20
Shiori
Simple bookmark manager built with Go
Shiori is a simple bookmarks manager written in the Go language. Intended as a simple clone of Pocket. You can use it as a command line application or as a web application. This application is distributed as a single binary, which means it can be installed and used easily. Basic bookmarks management i.e. add, edit, delete and search. Import and export bookmarks from and to Netscape Bookmark file. Import bookmarks from Pocket. Simple and clean command line interface. Simple and pretty web... -
21
k3sup
bootstrap K3s over SSH in < 60s
... for your host's public IP so that TLS works properly. The kubeconfig file on the server is then fetched and updated so that you can connect from your laptop using kubectl. k3sup was developed to automate what can be a very manual and confusing process for many developers, who are already short on time. Once you've provisioned a VM with your favorite tooling, k3sup means you are only 60 seconds away from running kubectl get pods on your own computer. -
22
PacketStreamer
Distributed tcpdump for cloud native environments
... PacketStreamer streams from multiple remote sensors and writes the packets to a local pcap capture file. PacketStreamer sensors collect raw network packets on remote hosts. It selects packets to capture using a BPF filter, and forwards them to a central receiver process where they are written in pcap format. Sensors are very lightweight and impose little performance impact on the remote hosts. PacketStreamer sensors can be run on bare-metal servers, on Docker hosts, and on Kubernetes nodes. -
23
pastebin-ipfs
Pastebin built on IPFS, securely served by Distributed Web and Edge
Pastebin built on IPFS, securely served by Distributed Web and Edge Networks. It's like gist but anonymous. Alternative to Ubuntu Pastebin. Webpage serves Gallery and provide GUI to paste your snippets. -
24
alvd
alvd = A Lightweight Vald. A lightweight distributed vector search
A lightweight distributed vector search engine based on Vald codebase. Vald is an awesome highly scalable distributed vector search engine works on Kubernetes. It has great features such as file-based backup, and metrics-based ordering of Agents. Also, Vald is highly configurable using YAML files. It works without Kubernetes, single binary (less than 30MB), easy to run (can be configured by command-line options), and consists of Agent and Server. alvd has almost the same features as Vald's... -
25
Gilfoyle
Distributed video encoding, hosting and streaming
Gilfoyle is a web application from the Dreamvo project that runs a self-hosted media streaming server. Allowing you to easily implement media streaming in any application at any scale. It's written in Golang, mostly designed for Kubernetes and runs as a single Linux binary with PostgreSQL and RabbitMQ.