Search Results for "distributed file"
Sort By:
Showing 295 open source projects for "distributed file"
View related business solutions-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
1
Zipkin
Distributed tracing system to gather timing data
Zipkin is a distributed tracing system. It helps gather timing data needed to troubleshoot latency problems in service architectures. Features include both the collection and lookup of this data. If you have a trace ID in a log file, you can jump directly to it. Otherwise, you can query based on attributes such as service, operation name, tags and duration. -
2
Spacedrive
Spacedrive is an open source cross-platform file explorer
...For independent creatives, hoarders ,and those who want to own their digital footprint, Spacedrive provides a free file management experience like no other. A VDFS (virtual distributed filesystem) is a filesystem designed to work across a variety of storage layers. -
3
JupyterLab
JupyterLab computational environment
JupyterLab is the next-generation web-based user interface for Project Jupyter. Try it on Binder. JupyterLab follows the Jupyter Community Guides. JupyterLab enables you to work with documents and activities such as Jupyter notebooks, text editors, terminals, and custom components in a flexible, integrated, and extensible manner. You can arrange multiple documents and activities side by side in the work area using tabs and splitters. Documents and activities integrate with each other,... -
4
SeaweedFS
Distributed storage system for blobs, objects, files, and data lake
...SeaweedFS is a simple and highly scalable distributed file system. There are two objectives, to store billions of files, and to serve the files fast! SeaweedFS started as an Object Store to handle small files efficiently. Instead of managing all file metadata in a central master, the central master only manages volumes on volume servers, and these volume servers manage files and their metadata. -
Cut Data Warehouse Costs by 54%BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
-
5
Go Micro
A framework for distributed systems development
Go Micro is a framework for distributed systems development. Go Micro provides the core requirements for distributed systems development including RPC and Event driven communication. The Micro philosophy is sane defaults with a pluggable architecture. We provide defaults to get you started quickly but everything can be easily swapped out. Auth is built in as a first class citizen. -
6
Dufs
A file server that supports static serving, uploading, searching
...Account-based rules provide read-only or read-write permissions for specific paths, including anonymous access when desired. The server supports HTTPS, CORS, custom assets, hidden-path rules, index rendering, and single-page applications. It is distributed through Cargo, Docker, Homebrew, and prebuilt binaries for Windows, macOS, and Linux. -
7
Cloud Storage FUSE
A user-space file system for interacting with Google Cloud Storage
...It supports performance optimizations like file caching, which stores frequently accessed data on local storage to significantly improve throughput and reduce latency. The system integrates with cloud-native environments such as Kubernetes and can be used in distributed architectures where multiple compute nodes access shared datasets. -
8
Apache HBase
Get random, realtime read/write access to your Big Data
...This project's goal is the hosting of very large tables, billions of rows X millions of columns, atop clusters of commodity hardware. Apache HBase is an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable. A Distributed Storage System for Structured Data by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, Apache HBase provides Bigtable-like capabilities on top of Hadoop and HDFS. Thrift gateway and a REST-ful Web service that supports XML, Protobuf, and binary data encoding options. ... -
9
DeepFlow
Application Observability using eBPF
...In addition to analyzing common protocols, Wasm plugins are supported for your private protocols. Full-stack golden signals of applications and infrastructures are calculated, pinpointing performance bottlenecks at ease. Zero Code distributed tracing powered by eBPF supports applications in any language and infrastructures including gateways, service meshes, databases, message queues, DNS, and NICs, leaving no blind spots. Full-stack network performance metrics and file I/O events are automatically collected for each Span. Distributed tracing enters a new era, Zero Instrumentation. ... -
Paessler - Monitor Your Whole Network in MinutesWaiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
-
10
Pholcus
Distributed high-concurrency crawler software written in pure golang
Pholcus is a high-concurrency crawler software written in pure Go language that supports distributed, only used for programming learning and research. It supports three operating modes of stand-alone, server and client, and has three operating interfaces, Web, GUI, and command line; simple and flexible rules, concurrent batch tasks, and rich output methods (mysql/mongodb/kafka/csv/excel, etc.); In addition, it also supports horizontal and vertical grabbing modes, and a series of advanced... -
11
i2pd
I2P: End-to-End encrypted and anonymous Internet
i2pd (I2P Daemon) is a lightweight, full-featured C++ implementation of the I2P (Invisible Internet Project) protocol, designed for enabling anonymous, encrypted, and censorship-resistant communication. It functions as a router node in the I2P network, supporting services like anonymous websites (eepsites), email, file sharing, and secure messaging. i2pd is designed to be resource-efficient and suitable for running on embedded systems or routers while maintaining compatibility with the wider... -
12
Rook
Storage Orchestration for Kubernetes
Rook turns distributed storage systems into self-managing, self-scaling, self-healing storage services. It automates the tasks of a storage administrator: deployment, bootstrapping, configuration, provisioning, scaling, upgrading, migration, disaster recovery, monitoring, and resource management. Rook orchestrates the Ceph storage solution, with a specialized Kubernetes Operator to automate management. Rook ensures that Ceph will run well on Kubernetes and simplify the deployment and... -
13
k3sup
bootstrap K3s over SSH in < 60s
k3sup is a lightweight utility to get from zero to KUBECONFIG with k3s on any local or remote VM. All you need is ssh access and the k3sup binary to get kubectl access immediately. The tool is written in Go and is cross-compiled for Linux, Windows, MacOS and even on Raspberry Pi. This tool uses ssh to install k3s to a remote Linux host. You can also use it to join existing Linux hosts into a k3s cluster as agents. First, k3s is installed using the utility script from Rancher, along with a... -
14
linuxptp
PTP IEEE 1588 stack for Linux
This project is an implementation of the Precision Time Protocol (PTP) according to IEEE standard 1588 for Linux. -
15
AWS IoT Jobs library
Client library for using AWS IoT Jobs service on embedded devices
The AWS IoT Jobs library helps you notify connected IoT devices of a pending Job. A Job can be used to manage your fleet of devices, update firmware and security certificates on your devices, or perform administrative tasks such as restarting devices and performing diagnostics. It interacts with the AWS IoT Jobs service using MQTT, a lightweight publish-subscribe protocol. This library provides a convenience API to compose and recognize the MQTT topic strings used by the Jobs service. The... -
16
AWS IoT Device Shadow library
Client library for using AWS IoT Shadow service on embedded devices
The AWS IoT Device Shadow library enables you to store and retrieve the current state (the “shadow”) of every registered device. The device’s shadow is a persistent, virtual representation of your device that you can interact with from AWS IoT Core even if the device is offline. The device state is captured as its “shadow” within a JSON document. The device can send commands over MQTT to get, update and delete its latest state as well as receive notifications over MQTT about changes in its... -
17
AWS IoT Device Defender Library
Client library for using AWS IoT Defender service on embedded devices
The Device Defender library enables you to send device metrics to the AWS IoT Device Defender Service. This library also supports custom metrics, a feature that helps you monitor operational health metrics that are unique to your fleet or use case. For example, you can define a new metric to monitor the memory usage or CPU usage on your devices. This library has no dependencies on any additional libraries other than the standard C library, and therefore, can be used with any MQTT client... -
18
Oddjob
Java Job Scheduling and Task Automation
A flexible job scheduler for the distributed environment. Schedule a job on any server - from any server. Create dependencies and trigger alerts across the network. Monitor and control it all from your desktop. -
19
BRL-CAD
Open Source Solid Modeling CAD
BRL-CAD is a powerful cross-platform constructive solid geometry solid modeling system that includes an interactive geometry editor, ray-tracing for rendering & geometric analyses, network distributed framebuffer support, image & signal-processing tools. -
20
MooseFS
Fault tolerant, POSIX-compliant, Net Distributed Storage / File System
MooseFS (MFS) is a fault tolerant, highly performing, scaling-out, network distributed file system. It spreads data over several physical servers which are visible to the user as one resource. For standard file operations MooseFS mounted with FUSE acts as other Unix-alike file systems: * A hierarchical structure (directory tree) * Stores POSIX file attributes (permissions, last access and modification times) Supports special files (block and character devices, pipes and sockets) * Symbolic links (file names pointing to target files, not necessarily on MooseFS) and hard links (different names of files which refer to the same data on MooseFS) * Access to the file system can be limited based on IP address and/or password MooseFS on GitHub: https://github.com/moosefs/moosefs Packages repository, download: https://moosefs.com/download Documentation: https://moosefs.com/support Recent changes: https://github.com/moosefs/moosefs/blob/master/NEWS -
21
Portable Moodle - MoodlEasy
Portable Moodle as easy as it gets for beginners to learn LMS
MoodlEasy (with Moodle Version 2.5 / 2014, Windows only) is intended to make learning Moodle as easy as possible for beginners. It is not intended for actual use online. It is based on two freely distributed tools: LMS Moodle and USBWebserver. Setup as easy as: extract the downloaded archive (use 7zip or other file archiver) to " C:\ " drive only !!! LOGIN and PASSWORD are the same: “admin”. Also suitable for working offline for teachers and students. Users can start using Moodle immediately after clicking on executable file via automatically opened browser. ... -
22
Bit-Twist (Packet generator/editor)
Packet generator and packet editor for Windows, Linux, BSD, and macOS
Supported systems: Windows, Linux, BSD, and macOS. Bit-Twist is a simple yet powerful libpcap-based Ethernet packet generator and packet editor. It is designed to complement tcpdump, which by itself has done a great job at capturing network traffic. With Bit-Twist, you can now regenerate your captured traffic onto a live network! Packets are generated from tcpdump trace file (.pcap file). Bit-Twist comes with a comprehensive trace file editor to allow you to change the contents of a... -
23
UNICORE
UNiform Interface to COmputing and data REsources
UNICORE is a software suite for building federated systems, providing secure and seamless access to heterogeneous resource such as compute clusters and file systems. UNICORE deals with authentication, user mapping and authorization, and provides a comprehensive set of RESTful APIs for HPC access and workflows. Contributors: visit https://github.com/UNICORE-EU -
24
JDiskCat
Multi-platform disk cataloguing utility written in java.
...Download package consists of a jar file and a Eclipse project with a full source code. No installation is required. You can copy this program anywhere or transfer it to another computer. Setting unique volume label to a drive before cataloguing is recommended. See blog or homepage for news and changelog. This program requires JRE 8 or newer. -
25
RabbitRemoteControl
Remote control. Support VNC, RDP, Terminal, SSH, TELNET etc
Rabbit Remote Control is a open-source, cross-platform, multi-protocol remote control software. Allows you to use any device and system in anywhere and remotely manage any device and system in any way. Its goal is to be simple, convenient, security and easy to use, improving work efficiency. It include remote desktop, remote control, file transfer(FTP, SFTP), terminal, remote terminal(SSH, TELNET), player, network tools etc functions. This is only a read-only mirror...
