Search Results for "data file"
Sort By:
Showing 22 open source projects for "data file"
View related business solutions-
Train ML Models With SQL You Already KnowBuild and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.
-
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
1
Syncthing
Open Source Continuous File Synchronization
Syncthing is an open source continuous file synchronization program, which essentially works by synchronizing files between two or more computers in real time. Syncthing is designed to first and foremost keep users’ data safe and protected against data loss and against attackers who would unlawfully try and access this data. It doesn’t store data anywhere else except on your computers and uses encryption to secure all your data. -
2
CasaOS
A simple, easy-to-use, elegant open-source Personal Cloud system
CasaOS by IceWhaleTech is a personal cloud OS designed around Docker. It offers a simple, elegant UI and streamlined installer to manage local storage, apps, media, and smart home services, all self-hosted. -
3
Cloud Storage FUSE
A user-space file system for interacting with Google Cloud Storage
Cloud Storage FUSE is an open-source user-space file system adapter that allows Google Cloud Storage buckets to be mounted and accessed as if they were local file systems on a machine. This approach enables applications to interact with cloud storage using standard file system semantics, eliminating the need to rewrite code to use object storage APIs directly. The tool is particularly valuable in data-intensive workflows such as machine learning, where large datasets can be accessed on demand without requiring full local downloads. ... -
4
CoreDNS
CoreDNS is a DNS server that chains plugins
...Retrieve zone data from primaries, i.e., act as a secondary server (AXFR only) (secondary). Sign zone data on-the-fly (dnssec). Load balancing of responses (loadbalance). Allow for zone transfers, i.e., act as a primary server (file + transfer). Automatically load zone files from disk (auto). -
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
5
plakar
plakar is a backup solution powered by Kloset and ptar
plakar is an open-source backup solution designed to protect files, application data, and contextual metadata in a scalable way. It goes beyond basic file copying by storing data and its surrounding context inside Kloset, an immutable open-source data store. The project focuses on making backups easy to start while still supporting advanced data protection scenarios. It emphasizes security through end-to-end encryption for both backup data and metadata. ... -
6
SeaweedFS
Distributed storage system for blobs, objects, files, and data lake
...SeaweedFS is a simple and highly scalable distributed file system. There are two objectives, to store billions of files, and to serve the files fast! SeaweedFS started as an Object Store to handle small files efficiently. Instead of managing all file metadata in a central master, the central master only manages volumes on volume servers, and these volume servers manage files and their metadata. -
7
Fabio
Consul Load-Balancing made simple
Fabio is an HTTP and TCP reverse proxy that configures itself with data from Consul. Traditional load balancers and reverse proxies need to be configured with a config file. The configuration contains the hostnames and paths the proxy is forwarding to upstream services. This process can be automated with tools like consul-template that generate config files and trigger a reload. Fabio works differently since it updates its routing table directly from the data stored in Consul as soon as there is a change and without restart or reloading. ... -
8
BigQuery Emulator
BigQuery emulator server implemented in Go
BigQuery Emulator is an open-source server implementation that replicates the behavior of Google Cloud’s BigQuery service locally, enabling developers to test and develop data workflows without connecting to the real cloud environment. Written in Go, it can run as a standalone binary, Docker container, or embedded library within test environments, making it highly flexible for different workflows. The emulator supports a large portion of the BigQuery API surface, including dataset management, query execution, and data ingestion, allowing applications to interact with it as if it were the real service. ... -
9
IPFS
IPFS implementation in Go
A peer-to-peer hypermedia protocol designed to make the web faster, safer, and more open. HTTP downloads files from one computer at a time instead of getting pieces from multiple computers simultaneously. Peer-to-peer IPFS saves big on bandwidth, up to 60% for video, making it possible to efficiently distribute high volumes of data without duplication. The average lifespan of a web page is 100 days before it's gone forever. It's not good enough for the primary medium of our era to be this... -
$300 Free Credits to Build on Google CloudStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
-
10
Go Micro
A framework for distributed systems development
...This additionally includes rule based access control. Load and hot reload dynamic config from anywhere. The config interface provides a way to load application level config from any source such as env vars, file, etcd. You can merge the sources and even define fallbacks. A simple data store interface to read, write and delete records. It includes support for memory, file and CockroachDB by default. -
11
Go MySQL Driver
MySQL driver for Go's (golang) database/sql package
...Automatic handling of broken connections, as well as automatic Connection Pooling (by database/sql package). Supports queries larger than 16MB. Full sql.RawBytes support. It provides intelligent LONG DATA handling in prepared statements. Secure LOAD DATA LOCAL INFILE support with file allowlisting and io.Reader support. Optional time.Time parsing, as well as optional placeholder interpolation. db.SetConnMaxLifetime() is required to ensure connections are closed by the driver safely before connection is closed by MySQL server, OS, or other middlewares. ... -
12
Rook
Storage Orchestration for Kubernetes
Rook turns distributed storage systems into self-managing, self-scaling, self-healing storage services. It automates the tasks of a storage administrator: deployment, bootstrapping, configuration, provisioning, scaling, upgrading, migration, disaster recovery, monitoring, and resource management. Rook orchestrates the Ceph storage solution, with a specialized Kubernetes Operator to automate management. Rook ensures that Ceph will run well on Kubernetes and simplify the deployment and... -
13
Zarf
DevSecOps for Air Gap & Limited-Connection Systems
Zarf eliminates the complexity of air gap software delivery for Kubernetes clusters and cloud-native workloads using a declarative packaging strategy to support DevSecOps in offline and semi-connected environments. -
14
endlessh-go
A golang implementation of endlessh exporting Prometheus metrics
...Unfortunately the wonderful original C implementation of endlessh only provides text based log, but I do not like the solution that writes extra scripts to parse the log outputs, then exports the results to a dashboard, because it would introduce extra layers in my current setup and it would depend on the format of the text log file rather than some structured data. Thus I create this golang implementation of endlessh to export Prometheus metrics and a Grafana dashboard to visualize them. -
15
DeepFlow
Application Observability using eBPF
...Zero Code distributed tracing powered by eBPF supports applications in any language and infrastructures including gateways, service meshes, databases, message queues, DNS, and NICs, leaving no blind spots. Full-stack network performance metrics and file I/O events are automatically collected for each Span. Distributed tracing enters a new era, Zero Instrumentation. DeepFlow collects profiling data at a cost of below 1% with Zero Code, plots OnCPU/OffCPU function call stack flame graphs, and locates Full Stack performance bottleneck in the application. -
16
Loggie
A lightweight, cloud-native data transfer agent and aggregator
Loggie is a lightweight, high-performance, cloud-native agent and aggregator based on Golang. Loggie includes LogConfig/ClusterLogConfig/Interceptor/Sink CRDs, allowing for the creation of data collection, transfer, processing, and sending pipelines through simple YAML file creation. Supports deployment as an independent intermediate machine, which can receive aggregated data sent by Loggie Agent and can also be used to consume and process various data sources. Configure Filebeat and Loggie to collect logs, and send them to a Kafka topic without using client compression, with the Kafka topic partition configured as 3. ... -
17
surge
Surge is a p2p filesharing app designed to utilize blockchain
Surge is a peer-to-peer file-sharing application that leverages blockchain technologies to facilitate anonymous and secure file transfers. It employs end-to-end encryption and a decentralized network to ensure user privacy and data integrity. Surge's design focuses on simplicity and anonymity, making it a suitable choice for users seeking private file-sharing solutions. -
18
GazerNode
Monitoring and control system
This is a small and simple application that runs as a Windows service to record metrics several times per second. Metrics can be very different. For example, memory usage by a process or ping to a host. The application does not require a DBMS. The data is stored in an open binary format. Data viewing is possible in the form of graphs of the history of changes and in tables of current values. The configuration setting is done without editing the config files - everything is available directly... -
19
drive
Google Drive client for the commandline
drive is a tiny program to pull or push Google Drive files. Make sure to set your GOPATH in your env, .bashrc or .bash_profile file. You can install scripts for automating major drive commands and syncing from drive-google wiki, also described in platform_packages.md. See file Makefile which currently supports cross compilation. Just run make and then inspect the binaries in directory bin. drive supports resource configuration files (.driverc) that you can place both globally (in your home... -
20
Docker Machine
Machine management for a container-centric world
Docker Machine is a tool that lets you install Docker Engine on virtual hosts, and manage the hosts with docker-machine commands. You can use Machine to create Docker hosts on your local Mac or Windows box, on your company network, in your data center, or on cloud providers like Azure, AWS, or DigitalOcean. Using docker-machine commands, you can start, inspect, stop, and restart a managed host, upgrade the Docker client and daemon, and configure a Docker client to talk to your host. Point... -
21
confd
Manage local application configuration files using templates from etcd
confd is a lightweight configuration management tool focused on keeping local configuration files up-to-date using data stored in etcd, consul, dynamodb, redis, vault, zookeeper, aws ssm parameter store or env vars and processing template resources. confd is also focused on reloading applications to pick up new config file changes. Go 1.10 is required to build confd, which uses the new vendor directory. You should have a working etcd, or consul server up and running and the ability to add new keys. ... -
22
Oasis Development Tool
OASIS Development Tool
The OASIS Development Tool is an innovative IDE for Code Generation-, Code Debugging- and Visual Coding- using the OASIS Programming Language. The OASIS Programming Language is a 4GL Concurrency- and Database Language running round a distributed OASIS Runtime Machine Environment (RME) as interpreted OASIS Scripts sequenced into OASIS Polyglot Runtime Components (PRC) with just in time patterns. The IDE is designed specifically for the OASIS Programming Language. The IDE is focused around the...
- Previous
- You're on page 1
- Next
