Search Results for "impact"

An API client for S3. AsyncAws has implemented the most popular API clients. If you want to upload a 1 Gb file, you really don't want to put that file in memory before uploading. You want to do it a smarter way. AsyncAws allows you to upload files using a string, resource, closure, or an iterable.

Retools is a set of modifications to the commonly used open source utilities bzip2, gzip, rsync, and tar that automatically selects the Lustre stripe count for created and/or extracted files according to the sizes of the files involved. By striping large files over a higher number of physical disks and small files over a lower number, aggregate I/O bandwidth for large files is maximized and the impact to the file system due to small files is minimized.

...The key feature of the software is that duplicate files should be detected, and incoming files have an MD5 checksum automatically generated. All upload details, including timestamp, uploaded-by, checksum, filename and location are all stored in a 2-table database. The software should not impact the FTP server software as it is run separately. Coming soon will be a complementary application that will run as a daemon and scan the logging database on a regular basis. Specific processing/handling will be available on a per-user basis. The package includes all documentation and scripts to help set up the MySQL database. The script is easy to configure for your own needs. ...