Search Results for "data"
Sort By:
Showing 132 open source projects for "data"
View related business solutions-
Ship AI Apps Faster with Vertex AIShip AI apps and features faster with Vertex AI—your end-to-end AI platform. Access Gemini 3 and 200+ foundation models, fine-tune for your needs, and deploy with enterprise-grade MLOps. Build chatbots, agents, or custom models. New customers get $300 in free credit.
-
99.99% Uptime for MySQL and PostgreSQL on Google CloudCloud SQL Enterprise Plus gives you a 99.99% availability SLA with near-zero downtime maintenance—typically under 10 seconds. Get 2x better read/write performance, intelligent data caching, and 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server with built-in vector search for gen AI apps. New customers get $300 in free credit.
-
1
DwarFS
A fast high compression read-only file system for Linux, Windows
...A fast high compression read-only file system for Linux and Windows. DwarFS is a read-only file system with a focus on achieving very high compression ratios in particular for very redundant data. This probably doesn't sound very exciting, because if it's redundant, it should compress well. However, I found that other read-only, compressed file systems don't do a very good job at making use of this redundancy. See here for a comparison with other compressed file systems. DwarFS also doesn't compromise on speed and for my use cases, I've found it to be on par with or perform better than SquashFS. ... -
2
CssSelector Component
Converts CSS selectors to XPath expressions
XPath expressions are incredibly flexible, so there is almost always an XPath expression that will find the element you need. Unfortunately, they can also become very complicated, and the learning curve is steep. Even common operations (such as finding an element with a particular class) can require long and unwieldy expressions. CSS selectors are less powerful than XPath, but far easier to write, read and understand. Since they are less powerful, almost all CSS selectors can be converted to... -
3
s3fs
FUSE-based file system backed by Amazon S3
s3fs allows Linux, macOS, and FreeBSD to mount an S3 bucket via FUSE. s3fs preserves the native object format for files, allowing use of other tools like AWS CLI. Large subset of POSIX including reading/writing files, directories, symlinks, mode, uid/gid, and extended attributes. Compatible with Amazon S3, and other S3-based object stores. Allows random writes and appends, large files via multi-part upload, and renames via server-side copy. User-specified regions, including Amazon GovCloud.... -
4
IPFS
IPFS implementation in Go
...HTTP downloads files from one computer at a time instead of getting pieces from multiple computers simultaneously. Peer-to-peer IPFS saves big on bandwidth, up to 60% for video, making it possible to efficiently distribute high volumes of data without duplication. The average lifespan of a web page is 100 days before it's gone forever. It's not good enough for the primary medium of our era to be this fragile. IPFS keeps every version of your files and makes it simple to set up resilient networks for mirroring data. The Internet has turbocharged innovation by being one of the great equalizers in human history, but increasing consolidation of control threatens that progress. ... -
Build on Google Cloud with $300 in Free CreditStart your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query exabytes in BigQuery, or build AI apps with Vertex AI and Gemini. Once your credits are used, keep building with 20+ products with free monthly usage, including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. Sign up to start building right away.
-
5
Claude Code Safety Net
A Claude Code plugin that acts as a safety net
...The repository defines patterns and reusable components for validating agent decisions, sanitizing user inputs, and enforcing operational boundaries, making it easier to design fail-safe integrations with both internal toolchains and external APIs. It includes example safety checks that cover common categories like infinite loops, unsafe system commands, data leakage risks, and visibility constraints, which help engineering teams anticipate and defend against unpredictable agent behavior. -
6
VeraCrypt
Open source disk encryption with strong security for the Paranoid
...This enhanced security adds some delay ONLY to the opening of encrypted partitions without any performance impact to the application use phase. This is acceptable to the legitimate owner but it makes it much harder for an attacker to gain access to the encrypted data. All released files are PGP signed with key ID=0x680D16DE, available on key servers and downloadable at https://www.idrix.fr/VeraCrypt/VeraCrypt_PGP_public_key.asc VeraCrypt can mount TrueCrypt volumes. It also can convert them to VeraCrypt format. Documentation: https://www.veracrypt.fr/en/Documentation.html FAQ : https://www.veracrypt.fr/en/FAQ.html -
7
WipeFreeSpace
Secure wiping/shredding of free disk space with many methods
...Additionally, WipeFreeSpace can finalize wiping the filesystem by writing blocks of zeros, which is friendly for sparse files, virtual systems and other places where zeroed-out space is not physically allocated. See the project homepage https://wipefreespace.sourceforge.io and the project Wiki in the menu above. To prevent clear-text data from being left on the drive in the first place, you can use LibSecRm (https://libsecrm.sourceforge.io), which wipes the data on-the-fly. -
8
Partclone is a project like the well-known backup utility "Partition Image" a.k.a partimage. Partclone provide utilities to back up used blocks and design for higher compatibility of the file system using supported library like e2fslibs.
-
9
NBT File System Utilities
Inspecting and manipulating NBT as a file system
Named Binary Tag (NBT) is a binary format designed for and used by the game Minecraft to store various data including worlds, player data and many other things. This project provides a way to access those data by simply mounting the corresponding data file as a file system, then reading and writing any value as usual file system nodes. By combining with standard Unix file operation tools, batch editing or copying massive amount of data is very easy, comparing to other generic NBT editing tools. ... -
AI-generated apps that pass security reviewRetool lets you generate dashboards, admin panels, and workflows directly on your data. Type something like “Build me a revenue dashboard on my Stripe data” and get a working app with security, permissions, and compliance built in from day one. Whether on our cloud or self-hosted, create the internal software your team needs without compromising enterprise standards or control.
-
10
MooseFS
Fault tolerant, POSIX-compliant, Net Distributed Storage / File System
MooseFS (MFS) is a fault tolerant, highly performing, scaling-out, network distributed file system. It spreads data over several physical servers which are visible to the user as one resource. For standard file operations MooseFS mounted with FUSE acts as other Unix-alike file systems: * A hierarchical structure (directory tree) * Stores POSIX file attributes (permissions, last access and modification times) Supports special files (block and character devices, pipes and sockets) * Symbolic links (file names pointing to target files, not necessarily on MooseFS) and hard links (different names of files which refer to the same data on MooseFS) * Access to the file system can be limited based on IP address and/or password MooseFS on GitHub: https://github.com/moosefs/moosefs Packages repository, download: https://moosefs.com/download Documentation: https://moosefs.com/support Recent changes: https://github.com/moosefs/moosefs/blob/master/NEWS -
11
fpart
Sort files and pack them into partitions
...Hooks are available to act on those partitions (e.g. immediatly start a transfer using rsync(1)) without having to wait for the filesystem traversal job to be finished. Used this way, fpart can be seen as a powerful data migration tool. -
12
s3cmd
Command line tool for managing Amazon S3 and CloudFront services
Open-source tool to access Amazon S3 file storage. S3cmd is a free command line tool and client for uploading, retrieving and managing data in Amazon S3 and other cloud storage service providers that use the S3 protocol, such as Google Cloud Storage. Lots of features and options have been added to s3cmd since its very first release in 2008.... we recently counted more than 60 command line options, including multipart uploads, encryption, incremental backup, s3 sync, ACL and Metadata management, S3 bucket size, bucket policies, and more! -
13
Xorin
Xorin data erase & clone software
Xorin is a secure drive erase program that provides the perfect solution to anyone who wants to secure their private data before selling or utilization their PC or drive storage. Xorin is also good in all situations where you want to ensure that deleted data stays deleted and that it can never be recovered. Xorin operates from its own Linux-based bootable environment, Linux or Windows operation system. Xorin supports all popular security methods and standards including DoD 5220.22-M. ... -
14
fast single-privilege single-address-space preemptive-multithreading persistent data-centric secure multiuser operating system with safe-language and reconfigurable graphical interface
-
15
Synchrorep
Synchronize directories
Synchrorep is a one click directory synchronization software. All modification will be reported to one to the other and vice versa. Usefull for nomads or speedup differencials backup. -
16
myrescue is a program to rescue the still-readable data from a damaged harddisk. It is similiar in purpose to dd_rescue, but it tries to quickly get out of damaged areas to first handle the not yet damaged part of the disk and return later.
-
17
Recover data from a partition or dd image from a console using python and sleuthkit
-
18
Heliogabalus
Heliogabalus Rescue Live Linux Distribution
Forensics, data rescue, data backup, OS and filesystem maintenance and administration. CLI experts only. -
19
...A cyclic log has a fixed size upon creation and pointers that refer to the start and end positions within that fixed size.They are useful for recording server output without losing the most recent data.
-
20
diskover
File system crawler and disk space usage software
diskover is a file system crawler and disk space usage software that uses Elasticsearch to index your file metadata. diskover crawls and indexes your files on a local computer or remote storage server over network mounts. diskover helps manage your storage by identifying old and unused files and give better insights into data change "hotfiles", file duplication "dupes" and wasted space. It is designed to help deal with managing large amounts of data growth and provide detailed storage analytics. See GitHub for requirements and instructions on installing. -
21
-
22
transformenator
Text and binary file transformation
Text and binary file transformation. Text-based sed, awk, etc. failed me when I needed a simple way to transform binary files to something else. Transformenator is what resulted. -
23
...A shell command generates the contents of the files on request, perhaps from the source files. Configurable caching and monitoring of the source tree to limit CPUand prefetch data.
-
24
DemuxFS is a live filesystem to aid on the analysis of transport streams in digital TV systems such as the SBTVD (ISDB-T), DVB and ATSC.
-
25
ISOLabel
Change volume label on ISO 9660 image and Joliet extension
isolabel is a program that allows you to change volume label in ISO 9660 image file after it was already created. Moreover, you can specify ISO 9660 and Joliet volume label separately, taking advantage of fancy names in Joliet together with simpler, but longer name in ISO 9660; something that tools like mkisofs/genisoimage does not allow you to do in standard compliant way. This program is written to have minimal software dependency, and work on all platforms.
