Menu

Shift 5.0 released

CHANGES
- Added better detection of lan transfers in stats
- Added error handling for malformed tar headers
- Added --buffer option to adjust buffer size used by underlying transports
- Added --streams option to adjust tcp streams used by tcp-based transports
- Added --window option to set tcp window size used by tcp-based transports
- Added --ports option to set the remote ports used by tcp-based transports
- Added --threads option to set number of threads used by local transports
- Added --bandwidth option to set bandwidth for stream/window calculation
- Added adjustment of tcp window/streams based on b/w heuristics and latency
- Added ability to set small file breakeven points for local/lan/wan cases
- Added minimum split setting to prevent file system overload with metadata
- Added rescan of mesh keys between batches to pick up newly generated keys
- Added support for bbcp as underlying transport
- Added support for all remote transports to be used as local transports
- Added manager setting for lustre default stripe count
- Added multi-threading of single/multi-file batches to built-in transports
- Added multi-threading of single/multi-file batches to built-in hashing
- Added multi-threaded tcp-based remote transport based on fish protocol
- Added support for --verify-fast during fish gets
- Added output across transfers of all users when --status invoked as root
- Added zero-padding to duration and estimated time when --status=pad used
- Changed status emails to limit length of original command sent
- Changed brief status so at least one completed transfer is always shown
- Changed --encrypt to --secure, which also changes ssh cipher/mac selection
- Changed dmput handling so -r is no longer used in automatic offlining
- Changed help output into functional units
- Changed external invocations to eliminate all extra shell processes
- Changed client selection to use selection hook instead of random policy
- Changed shift-aux sums so file issues are errors and not bad checksums
- Changed handling of estimated completion to reflect actual operation rates
- Changed extraction of tar files to remove relative path components
- Changed --stats output to omit rows without non-empty values
- Fixed gridftp support using unbuffer utility to interlace stderr/stdout
- Fixed umask for root transfers so won't inadvertently expose files
- Fixed status after --wait, which sometimes did not appear when redirected
- Fixed getting/setting of acls and xattrs on symlinks
- Fixed existence check of target path when using openssh 7.x
- Fixed infinite loop in built-in hashing when source file shrinks
- Fixed reported rate when operations report in after transfer stopped
- Fixed improper dst truncation in some non-tar corruption recovery cases
- Fixed infinite loop when extracting tar files less than 512 bytes
- Fixed host/process failures due to dmgets on every command line file
- Fixed --include/--exclude options to handle malformed regular expressions
- Fixed truncation of built-in local copies when dst larger than src
- Fixed toc file empty blocks of increasing size during split tar creation
- Fixed built-in hashing chopping off range when file has backslash/newline
- Fixed correction of corruption in multiple byte ranges during tar creation
- Fixed distribution of clients to remote hosts when more clients than hosts
- Fixed built-in transport detection when user $PATH is empty
- Fixed sum file rename when no regular files during tar creation
- Fixed -d with unwritable or trailing slash dst (bug report by J. Otey)
- Fixed exception in fish protocol when input stream is invalid
- Fixed transport selection order when first transport not suitable
- Fixed crontab handling with csh variants
- Fixed exception when fish input stream is unreadable
- Fixed mkdir errors during parallelization in some scenarios
- Fixed sum file rename when transfer w/o regular files grouped with regular
- Fixed abort due to embedded use of Time::HiRes in some perl versions
- Removed use of File::Copy for built-in local copies

Posted by Paul Kolano 2016-07-13

Log in to post a comment.

Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.