Search Results for "large files"
Sort By:
Showing 30 open source projects for "large files"
View related business solutions-
Build Agents and Models on One PlatformGemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
-
$300 Free Credits for Your Google Cloud ProjectsLaunch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
-
1
s3fs
FUSE-based file system backed by Amazon S3
s3fs allows Linux, macOS, and FreeBSD to mount an S3 bucket via FUSE. s3fs preserves the native object format for files, allowing use of other tools like AWS CLI. Large subset of POSIX including reading/writing files, directories, symlinks, mode, uid/gid, and extended attributes. Compatible with Amazon S3, and other S3-based object stores. Allows random writes and appends, large files via multi-part upload, and renames via server-side copy. User-specified regions, including Amazon GovCloud. ... -
2
LaiNES
Compact cycle-accurate NES emulator
...Its design focuses on accurately simulating the NES hardware at the clock-cycle level, ensuring that timing-sensitive behaviors and edge cases are faithfully reproduced. Despite its relatively small codebase, it supports a wide range of cartridge mappers, enabling compatibility with a large portion of NES games. The emulator includes a simple graphical interface that allows users to browse files, configure settings, and manage gameplay without relying on external tools. It also provides savestate functionality that captures the full emulator state, including CPU, graphics, and audio subsystems, allowing users to resume gameplay seamlessly. ... -
3
Swiss File Knife
One hundred command line tools in a small and portable binary.
Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ... -
4
DAR - Disk ARchive
For full, incremental, compressed and encrypted backups or archives
DAR is a command-line backup and archiving tool that uses selective compression (not compressing already compressed files), strong encryption, may split an archive in different files of given size and provides on-fly hashing, supports differential backup with or without binary delta, ftp and sftp protocols to remote cloud storage Archive internal's catalog, allows very quick restoration even a single file from a huge, eventually sliced, compressed, encrypted archive eventually located on... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
5
pmfow
Package Manager for Old Windows
... - 512 MB of RAM (needed to run versions of Windows newer than XP) or enough RAM to use a web browser. - At least 300 MB of storage available - A good internet connection (good enough to download somewhat large files). -
6
sfxPackager
Setup / install creation system for Windows.
(NOW PRIMARILY HOSTED ON GITHUB @ https://www.github.com/keelanstuart/sfxPackager) Youtube video tutorials for sfxPackager: https://youtube.com/playlist?list=PLaed72lE3UjgzdL1qOys-vxemSUOeGJWf sfxPackager allows you to create setup / install packages for Windows, with a user-friendly, project-based GUI and integrated Javascript interpreter featuring an extensive API for handling more complex install tasks. User's Guide:... -
7
OnnxStream
Lightweight inference library for ONNX files, written in C++
The challenge is to run Stable Diffusion 1.5, which includes a large transformer model with almost 1 billion parameters, on a Raspberry Pi Zero 2, which is a microcomputer with 512MB of RAM, without adding more swap space and without offloading intermediate results on disk. The recommended minimum RAM/VRAM for Stable Diffusion 1.5 is typically 8GB. Generally, major machine learning frameworks and libraries are focused on minimizing inference latency and/or maximizing throughput, all of which... -
8
Annoy
Approximate Nearest Neighbors in C++/Python optimized for memory usage
Annoy (Approximate Nearest Neighbors Oh Yeah) is a C++ library with Python bindings to search for points in space that are close to a given query point. It also creates large read-only file-based data structures that are mmapped into memory so that many processes may share the same data. There are some other libraries to do nearest neighbor search. Annoy is almost as fast as the fastest libraries, (see below), but there is actually another feature that really sets Annoy apart: it has the ability to use static files as indexes. ... -
9
CDC File Transfer
Tools for synching and streaming files from Windows to Linux
cdc-file-transfer is a bandwidth-efficient file transfer and sync tool that uses content-defined chunking to detect and transmit only the parts of files that actually changed. Unlike fixed-size blocks, content-defined chunks are cut at data-dependent boundaries, which means shifts and insertions don’t invalidate the rest of the file’s delta map. The tool maintains chunk fingerprints and a manifest so it can de-duplicate across versions and even across different files that share regions of content. ... -
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
10
MultiThreaded TFTP Server Open Source Freeware Windows/Unix for PXEBOOT, firmware load, support tsize, blksize, timeout Server Port Ranges, Block Number Rollover for Large Files. Runs as Service/daemon. Single Port version also available. Download
-
11
bin64ed
Base64 encode (or decode) files of any type with this lightweight tool
bin64ed is a binary base64 encoder/decoder that allows you to encode/decode binary files (such as images, pdfs, etc) to and from base64. -
12
vcproj2cmake
Visual Studio .vc[x]proj to CMakeLists.txt (make, Ninja ...) enabler
Elaborate Visual Studio .vcxproj / .vcproj projects to CMakeLists.txt converter, enabling Makefile or Ninja or IDE builds, i.e. full multi-platform CMake functionality (Linux, Mac, Windows...). Live Update capability: supports side-by-side tracking of evolving original proj files, within build tree!! Script hooks for static CMake defs, powerful definition-to-variable mapping. Access to project data content is via git repository _only_ (it's a developer infrastructure project, thus alternatives are less suitable). Be aware of several branches available for checkout (git branch -a): "experimental_unverified" is for the daring (to start with current most featureful code), while usability of "experimental" always gets hardened via a large build. ... -
13
Unix GNU Windows
Packages to create a Unix like environment under MS-Windows
At this point this project is mainly wpkg which is a replica of dpkg and apt-get that works under Microsoft Windows and Unices. Since version 0.7.0 it works very nicely as it includes most of the important functionality of dpkg (i.e. most everything except dselect functions.) Otherwise, the Unix GNU Windows is expected to be a large set of packages that wpkg can handle. Packages of all the software available under MinGW and GnuWin32 so you can painlessly build a complete Unix like... -
14
Dropbox Lepton
Lepton is a tool and file format for losslessly compressing JPEGs
Lepton image compression, saving 22% losslessly from images at 15MB/s. Lepton achieves a 22% savings reduction for existing JPEG images, by predicting coefficients in JPEG blocks and feeding those predictions as context into an arithmetic coder. Lepton preserves the original file bit-for-bit perfectly. It compresses JPEG files at a rate of 5 megabytes per second and decodes them back to the original bits at 15 megabytes per second, securely, deterministically, and in under 24 megabytes of... -
15
mp3 library, advanced ID3V1 and ID3V2 tagger, player. Organize a large mp3 library, over 40,000 songs. Speech synthesis and tag backup utilities. Scripts to maintain and organize song files.
-
16
logras
logfile read and search utility
Single stream viewer for logging output spread over multiple (large) files, terminal based, for diagnostics use over e.g. slow ssh connections. -
17
DupLichaSe
A Fast Duplicate File Detector with graph based semi-automatic cleaner
...YES!! There is!! ...This Software will ALSO help you and delete duplicate files, after you must have taken action on a a FEW important files(i.e large files that are duplicates). ++Thanks to its trivial Graph based suggestion System -
18
fmstream
Read-write access to memory-mapped files on Windows and POSIX systems
...File mapping allows the process to use both random input and output (I/O) and sequential I/O. It also allows the process to work efficiently with a large data file, such as a database, without having to map the whole file into memory. Multiple processes can also use memory-mapped files to share data. -
19
qlsdup
GUI based lightweight duplicate file finder / remover.
...This is basically a reimplementation of dupfinder as: it doesn't compile on my computer, the executable won't work either, the projects seems dead and I didn't wanna work through the original code. So Look'n'Feel should be somewhat the same, though some changes have been made. Algorithm is simple and suitable for large file sets with few differences: basic set of duplicate candidates is determined by file size, then candidates are compared byte-wise. So for files which don't start to differ by growing at the tail it reduces read operations greatly compared to hash-based comparision (i.e. test case: 40GB of files, 16GB RAM, many differences: initial compare (uncached by OS) around 300sec, subsequent compare (relevant file parts cached by OS) ca. 2sec) Note: this program is not related to lsdup -
20
Split a large filesystem into groups of files of less than 4.5 gig so they can be burned to a DVD. No archiving, no compression, it makes hard links to the original files so you can easily delete the tree structure after you've burned them to DVD.
-
21
FastDup is a tool to find identical files within directory trees, with a focus on speed, many files, and large files. Extremely fast even on large sets of data.
-
22
The findstr is searching the words in the text and binary files in several codepages. The famouse 'grep' is very slow and get a lot memory for large binary files without ends of lines - findstr is fast and light, but it doesn't use regular expressions.
-
23
Alexandria is an archive system for large data amounts. Suitable for inhomogenous collections of books, media files, art items and other artifacts. Main focus is on easy usage, small executable file and portability.
-
24
Flexible, secure file-transfer utility similar to rsync achieving high transfer rates for both large and small files on networks with both LANs and WANs (networks with low or high latencies). Supports interactive batch as well as scripting operation.
-
25
CopyFile is flexible and persistent utility for searching and copying (large) files over Local Area Network (LAN). Supports for MultiThreading /pause/resume/integrity check/subdir recurse/queue(with autosave)/network listing with autosave and lots of oth
