Search Results for "big data"
Sort By:
Showing 15 open source projects for "big data"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Earn up to 16% annual interest with Nexo.Put idle assets to work with competitive interest rates, borrow without selling, and trade with precision. All in one platform. Geographic restrictions, eligibility, and terms apply.
-
1
LakeSoul
An end-to-end, realtime and cloud native Lakehouse framework
LakeSoul is a high-performance, unified table storage framework for big data lakes, supporting both streaming and batch data in a single format. Built on top of Apache Spark and leveraging Apache Arrow and Parquet, LakeSoul provides ACID transactions, schema evolution, and time travel. It is designed for large-scale data lake architectures that require consistency, efficiency, and easy integration with modern data stacks. -
2
BFG Repo-Cleaner
Remove large or troublesome blobs
The BFG is a simpler, faster alternative to git-filter-branch for cleansing bad data out of your Git repository history. You can use it for removing crazy big files, and for removing passwords, credentials and other private data. The git-filter-branch command is enormously powerful and can do things that the BFG can't, but the BFG is much better for the tasks above, because is faster and simpler. The BFG isn't particularily clever, but is focused on making the above tasks easy. ... -
3
MobX
A Simple, scalable state management
MobX is a battle tested library that makes state management simple and scalable by transparently applying functional reactive programming (TFRP). Write minimalistic, boilerplate free code that captures your intent. Trying to update a record field? Use the good old JavaScript assignment. Updating data in an asynchronous process? No special tools are required, the reactivity system will detect all your changes and propagate them out to where they are being used. All changes to and uses of... -
4
Foundatio
Pluggable foundation blocks for building distributed apps
Pluggable foundation blocks for building loosely coupled distributed apps. Includes implementations in Redis, Azure, AWS, RabbitMQ and in memory (for development). When building several big cloud applications we found a lack of great solutions (that's not to say there aren't solutions out there) for many key pieces to building scalable distributed applications while keeping the development experience simple. Wanted to build against abstract interfaces so that we could easily change... -
Try Google Cloud Risk-Free With $300 in CreditUse your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
-
5
Curve
Curve is a sandbox project hosted by the CNCF Foundation
A cloud-native distributed storage system. A sandbox project hosted by the CNCF Foundation. Curve is a modern storage system developed by netease, currently supporting file storage(CurveFS) and block storage(CurveBS). Now it's hosted at CNCF as a sandbox project. The performance, mixed, capacity cloud disk or persistent volume of virtual machine/container, and remote disks of physical machines. High-performance separation of storage and computation architecture: high-performance and low... -
6
GnuCopy is an Open-Source tool to copy and archive all your important data. It supports all important archive typs like Zip and Tar to guaranty an easy and secure exchange between all types of operating systems. Additionally, you can create profiles to blacklist or whitelist specific file types or folders to seperate your big data stores for backups.
-
7
Annoy
Approximate Nearest Neighbors in C++/Python optimized for memory usage
Annoy (Approximate Nearest Neighbors Oh Yeah) is a C++ library with Python bindings to search for points in space that are close to a given query point. It also creates large read-only file-based data structures that are mmapped into memory so that many processes may share the same data. There are some other libraries to do nearest neighbor search. Annoy is almost as fast as the fastest libraries, (see below), but there is actually another feature that really sets Annoy apart: it has the... -
8
A set of tools (command line and GUI) to provide a complete digital photo workflow for Unixes. EXIF headers are used as the central information repository, so users may change their software at any time without loosing any data.
-
9
Big 0
Generates file with zeros
I'm just a student beginning to learn C++. I created this very simple 70 line program that will generate a text file with your choice of extension however may bytes you enter. I believe this could be used to permanently wipe hard drives if reused multiple times. Or just use up a shit-ton of hard drive space on a computer if you choose to do so. I called it "Big 0" because it can generate a big file full of zeros. -
10
gzzzzzz
makes a "big" gzip file
gzzzzzz enlarges a given file 6 times and writes it as a gzip file. It therefor can be "decompressed" (which makes it 6 times smaller) with the standard gzip. This shows that gzip (and deflate and any compression tool that uses one of them) but also, as I expect, any other compression format can be used to augment data significantly. -
11
EODG
EODG is a web application to upload/download files from a local folder
The EO Data Gateway application provide web access to a local EO repository both for upload and download of Earth Observation data products. EODG has been designed to be a simple input/output gateway to the ESA Earth Observation data stored in the ESA Grid-Processing On Demand systems. Anyway, it can be used for sharing any other of files. EODG provides per user control (via groups) on files download and uploads (number of concurrent downloads, number of files downloaded per month,... -
12
FrincBackup
Incremtal backup tool supporting removable storage devices
FrincBackup means free incremental backup. It is developed for backing up a x TB NAS with storage devices in a logical volume to multiple removable storage devices, such as 500 GB USB hard drives. Files are backuped as files (not as an archive) and are readable without the need of a tool and without the need of FrincBackup itself (allthough there is a restore mode for better handling). -
13
Visual Disk Diet
Helps you visualize the space used on your drives with colorful chart.
...Feel free to use, modify or suggest ideas! It's pretty much a copy of Disk Space Fan but Open Source so it can be adapted to extended purposes (as browsing file system...) It's very fast on data drives (your data partition, usb drive...) It's NOT optimized for very large and complex drives such as big C: drive for now so it can take up to 10 minutes to scan it (and there is no feedback during this scan, so it can be frustrating). -
14
Given a collection of individual (big) files, which are backed up to a separate hard disk. When reorganizing by moving files into separate directories, this tool helps to perform the same move operations in the backup copy with minimal data transfer.
-
15
AIS - Associative Indexing Service, an application for storing bookmarks, memos, indexing of big (lifetime) archives for fast future access to the data by (personalized) keywords. In other words - it is an extension of human associative memory :)
- Previous
- You're on page 1
- Next
