Search Results for "large files"

Meli-Action is a GitHub Actions-based downloading and web archiving project designed for heavily restricted internet environments. It uses GitHub-hosted workflow runners to fetch content from direct links, YouTube, Telegram, Google Play, SoundCloud, and web pages. Downloaded files are committed into the user’s repository so they can be retrieved later through normal GitHub access. The project includes workflows for different content sources, plus a Python script that can render and save web pages as MHTML archives using a headless browser. It also handles large direct-download files by splitting them into smaller chunks that fit repository limits. ...

...SortPhotos includes options for copying versus moving files, recursive searches, silent or test modes, and customizable start times for when a “day” begins. It also prevents duplicate files by comparing content, with an option to keep duplicates if needed. With support for automation through launch agents or cron jobs, SortPhotos is well-suited for photographers, archivists, and anyone looking to streamline large personal or professional media collections.

Create zip files, extract zip files, replace text in files, search in files using expressions, stream text editor, instant command line ftp and http server, send folder via network, copy folder excluding sub folders and files, find duplicate files, run a command on all files of a folder, split and join large files, make md5 checksum lists of files, remove tab characters, convert CR/LF, list newest or biggest files of a folder, compare folders, treesize, show first or last lines of a file, find filenames fast using index files, rename many files using expressions, copy part of a file, change times of a file, set file time from filename, print colored text to terminal, convert csv to tab separated, download files from web, send http or udp requests, print tcp or udp traffic, create hexdump of files, join many text files into one, list nested .zip .tar .tar.gz .tar.bz2 archive contents. ...

...It is developped in C and available under the BSD license. It splits a list of directories and file trees into a certain number of partitions, trying to produce partitions with the same size and number of files. It can also produce partitions with a given number of files or a limited size. Once generated, partitions are either printed as file lists to stdout (default) or to files. Those lists can then be used by third party programs. Fpart also includes a live mode, which allows it to crawl very large filesystems and produce partitions in live. ...

...It supports any POSIX filesystem and implements advanced features for Lustre filesystems (list/purge files per OST or pool, read MDT changelogs...)

bin64ed is a binary base64 encoder/decoder that allows you to encode/decode binary files (such as images, pdfs, etc) to and from base64.

Now you no longer need to keep holding ctrl button to copy specific files. This app helps you copy a number of files, folders or text from a large unorganised group to anywhere in your computer at just a click of button. This for reducing errors in large selective copying. Let's say you went on a trip and have large number of photos. You need to select a all photos with you in it How will you do it?

...YES!! There is!! ...This Software will ALSO help you and delete duplicate files, after you must have taken action on a a FEW important files(i.e large files that are duplicates). ++Thanks to its trivial Graph based suggestion System

Split and Manage your Large Files The Easy Way!!

...This is basically a reimplementation of dupfinder as: it doesn't compile on my computer, the executable won't work either, the projects seems dead and I didn't wanna work through the original code. So Look'n'Feel should be somewhat the same, though some changes have been made. Algorithm is simple and suitable for large file sets with few differences: basic set of duplicate candidates is determined by file size, then candidates are compared byte-wise. So for files which don't start to differ by growing at the tail it reduces read operations greatly compared to hash-based comparision (i.e. test case: 40GB of files, 16GB RAM, many differences: initial compare (uncached by OS) around 300sec, subsequent compare (relevant file parts cached by OS) ca. 2sec) Note: this program is not related to lsdup

LANL-Purger is a purging system intended for use on larger parallel filesystems in which notifications or advanced queries are required before file deletion. The parallel code requires MPI and database storage uses a PostgresSQL server.

brn is a Perl-based command-line tool designed to ease the task of bulk renaming a large number of files. Started as a fork of the standard perl 'rename' tool, this project has since mutated significantly and is still undergoing rapid flux.

Split a large filesystem into groups of files of less than 4.5 gig so they can be burned to a DVD. No archiving, no compression, it makes hard links to the original files so you can easily delete the tree structure after you've burned them to DVD.

A free file splitting tool that cuts large files into smaller parts and a merge-script which you can copy to otherwise-too-small memory sticks etc and then put them together on the target computer.

Java application using tree map algorithms to visualise disc space usage. Lets find forgotten large "space-eaters" files in an easy way.

Finddupe is a VERY FAST command line C program to catalog very large archives, identifying duplicate files even when offline. It has many features. You can easily grep a catalog to find what you have, and locate where it is.

Mass Expand is a simple utility to decompress all archived files underneath a directory, useful for large torrent downloads.

Simple command-line file splitter. Split a (binary) file into a given number of slices, or slices of a given size. Output files are automatically numbered, and can be concatenated ("copy", "cat") to recover the original file. Large files supported.

Flexible, secure file-transfer utility similar to rsync achieving high transfer rates for both large and small files on networks with both LANs and WANs (networks with low or high latencies). Supports interactive batch as well as scripting operation.

For each File lets you run an arbitrary set of GNU BASH commands upon an arbitrary set of objects. The author often uses it to perform repetitive tasks such as renaming, extracting, moving, and manipulating a large number of files.

fbreak is a console application that allows you to break a large file into multiple smaller files (ie, for distribution on floppy disks).