SmartCopyTool Activity
Intelligently manage and manipulate large directory structures
Brought to you by:
mrsdbooth
Activity for SmartCopyTool
-
SmartCopyTool updated /readme.txt
-
-
-
Simon Booth committed [r27] on Code
Added Invert Selection option.
-
SmartCopy 2[2026] notice in the log.
-
Updated to .NET 10
-
-
Check for source == destination to avoid deleting files when asked to copy a directory over itself.
-
Aleksey posted a comment on discussion General Discussion
Hello, thank you very much for a good program under a free open source license! Added a program to a Russian-language site about free software, here is the link. I am ready to help with the translation of the program into Russian. The project is interesting, so please don't abandon it!
-
Stricter rate limit on progress reporting to reduce UI unresponsiveness.
-
-
Estimated progress when rescanning a directory tree
-
More accurate/stable time remaining estimates
-
Use total seconds for estimates.
-
Use double for percentage to get more accurate progress measure (and avoid divide by zero!).
-
Take files size into account when calculating progress of copy/move.
-
Fixed double copy when overwriting a file, resulting in spurious messages about skipping the file.
-
Sort by date modified option
-
Hmmm, not sure what could cause that. I just downloaded the current version from https://sourceforge.net/projects/smartcopytool/files/ to make sure it was sound (it seems to be). It scanned a directory on an internal drive containing a terabyte of movies in < 1 second, I selected a random 10GB worth and copied them to a temp directory on an external drive in 3-4 minutes. Everything I selected copied across correctly. Are your source and destination drives internal or external? Which file system are...
-
Carlos Ortega posted a comment on discussion General Discussion
Hi Simon, thanks for the response. I tried running it as admin, it's one of the first troubleshooting steps I took but it didn't help. So what is happneing is that it takes a really long time to scan the specified directory initially, much longer than normal. Then it is unable to copy, it freezes (not responding). I can see that it shows the wrong number of folders and file size at the bottom after selecting all folders/files. For example, I selected a few gigs worth of files, and it shows "106.5...
-
Hi Carlos, I've been using it with Windows 10 for a few years now and never had any problems - seems exactly the same as it did on Windows 7. Does it fail to launch, or is it unable to copy anything? It might be something to do with permissions either way, maybe try right-click and run as administrator?
-
Hello, I have been using your tool for quite some time and it has proven very helpful for me. I recently upgraded from Windows 7 to Windows 10 and found that the tool no longer works for me. I was wondering if Windows 10 is supported? Thank you.
-
Alex modified a comment on discussion General Discussion
Add an option to for each file: overwrite (same name as source).(source or any other extension) files if they are larger in the target folders, or to not copy over at all - if they are smaller in the target folder structure.
-
Richard Gralnik posted a comment on discussion General Discussion
Hi Simon, I finally learned enough Python to write the programs.It turned out to be more complicated than I originallythought (that's never happened before) and I endedup writing one program to identify folders to copy based on the presence of keywords in the path thena second program to actually copy each folder and allof its subdirectories. I also added logic to stop thecopy after a certain amount of data was copied withthe ability to pick up where it left off on another run(there are 8 TB of data...
-
Donald Petersen modified a comment on discussion General Discussion
It took me a little time to pin down the date filtering criteria. To help make things clearer I would suggest the following wording: Filter (eliminate) files created on or before: Filter (eliminate) files created after: Filter (eliminate) files modified on or before: Filter (eliminate) files modified after:
-
It took me a little time to pin down the date filtering criteria. To help make things clearer I would suggest the following wording: Filter (eliminate) files created on or before: Filter (eliminate) files created after: Filter (eliminate) files modified on or before: Filter (eliminate) files modified after:
-
Thanks, good catch - I've uploaded a new version with the sorting fixed to use a timestamp comparison rather than a text comparison :-)
-
Interesting. I can't see the Junctions with File Explorer (for example I don't see 'C:\Users\dwpet\Documents\My Music'), but apparently SmartCopyTool can see them. However, SmartCopyTool seems to have no problem accessing 'C:\Users\dwpet\ Music' so I think I'm fine here. I believe I have discovered a problem with your date sorting. When sorting on "Modified" you seem to be treating the date and time as a text field and sort "left to right". Thus, the collating sequence is: all January dates (regardless...
-
Yep, none of those are real folders - if you look in Explorer you'll see that they all have a little arrow on the icon, and if you try to open them you'll get "access denied" as well. What they actually are is virtual links to directories that now exist elsewhere (in some form), for compatibility with some older software, e.g. "My Music" is just a link to the folder "Music" in the same directory. There's a good explanation from Microsoft MVP here (a rare event!): https://answers.microsoft.com/en-us/insider/forum/all/i-cant-edit-my-own-start-menu-due-to-access-denied/518ccd7e-6e63-4eac-9a43-6467f93b380e...
-
Thanks. I see what you mean and I understand, Given that explaination I cn see that date filtering seem to be working as expected. However, now that I have focused on the log, I see that I'm being denied access to some (19) files. It seems to make no difference whether or not I run as an Administrator. Further more, I'm being denied access to: 'C:\Users\dwpet\Documents\My Music' is denied. 'C:\Users\dwpet\Documents\My Pictures' is denied. 'C:\Users\dwpet\Documents\My Videos' is denied. It looks to...
-
Ah, looking at the log messages in your screenshot I think I see what's happening... if the filters remove all files from the working path, meaning SmartCopy has nothing left to work with, it will prompt you for a new path (it does this whenever it has no files to work with, e.g. at startup). If you select the same directory again (which will be the default) it'll just rescan all the files you just removed with the filters, returning you right back to where you started :-)
-
Perhaps I am confused. For this example with date filtering, it seems to me that no files should be in the list. In fact, I can't seem to find any filtering specification that makes the list of files disappear.
-
Perhaps I am confused. For this example with date filtering, it seems to me that no files should be in the list. In fact, I can't seem to find any filtering specification that makes the list of files disappear.
-
Thanks, it looks good. I appreciate your help.
-
I've added the selected file count ... no idea why I didn't add it originally, it's easier to calculate than the size of the selected files!
-
Add selected files count to status bar
-
Thanks, I had not noticed that. I think if you gave the file count also it would be exactly what I had suggested.
-
Yep, sounds like it would be worth looking into - I don't think it would be hard. In the meantime, you can trying checking the box next to a folder - the 'Selected Folders' count that appears in the status bar will be an accurate count of how many folders below and including that directory contain files after the filtering (also the total size of the files in them).
-
I just tried running as Administrator and I agree it is still wrong. In fact, I got exactly the same result as when I took the screenshot I posted earlier. After date filtering I suspect that I won't know where the "found" files are located. Just because a folder "says" that there are no files "in me" that does not mean that there are not some files further "down the tree". Instead of counting the folders every time SmartCopy is run, perhaps you could have a special option where one could turn on...
-
Hi, it seems to be an issue with the C:\Users\Username folder in particular - the numbers in the status bar are what Windows reports when queried, but apparently it includes hidden folders which a user mode application can't actually access . If you run SmartCopy.exe as administrator the hidden folders will show up, and the status bar count should match what you see :-) :edit: actually it still doesn't match, because the count includes several virtual folders like Recent and Printhood that still...
-
Hi, it seems to be an issue with the C:\Users\Username folder in particular - the numbers in the status bar are what Windows reports when queried, but apparently it includes hidden folders which a user mode application can't actually access . If you run SmartCopy.exe as administrator the hidden folders will show up, and the status bar count should match what you see :-)
-
It appears that when counting "# folders" and "# files" you are counting the folders at the level BELOW the selected (highlighted) folder and the number of files IN the selected folder. Often times my manual counts agree with your reported counts. However, in the screen shot below it seems to me that the number of folders should be 20 not the 30 that you are reporting. Am I confused or is there a bug here? Thanks, Don
-
Simon, Thanks for the explanation. Richard On Tuesday, December 10, 2019, 11:07:37 AM PST, Simon Booth <mrsdbooth@users.sourceforge.net> wrote: Hah, yes sorry that is an obscure bit of code, and very 'Python'. It breaks down to something like: any(...) ... is the list formed by this expression non-empty [word in folder] ... true if the string 'folder' contains the string 'word' ... [for word in keywords] ... where we will use the name 'word' to refer to every item in the list 'keywords' It's basically...
-
Thank you very much for your speedy turn-around time for my request. I think that this will meet my needs nicely.
-
Hah, yes sorry that is an obscure bit of code, and very 'Python'. It breaks down to something like: any(...) ... is the list formed by this expression non-empty [word in folder] ... true if the string 'folder' contains the string 'word' ... [for word in keywords] ... where we will use the name 'word' to refer to every item in the list 'keywords' It's basically equivalent to something that would look more like this in other languages: foreach (string word in keywords) { if (folder.Contains(word))...
-
Simon, Thank you for the update. I'm still trying to understand some of the commands inthe original script so this helps a lot. If you don't mind, how does this statementrun: if any(word in folder for word in keywords): I don't see word or folder defined or used beforethis and they aren't reserved words. Am I supposedto substitute them for something? Richard On Monday, December 9, 2019, 3:08:33 PM PST, Simon Booth <mrsdbooth@users.sourceforge.net> wrote: I've updated the Python script to handle directories...
-
I've updated the Python script to handle directories that already exist at the destination more intelligently - it'll just copy any files that are missing, rather than re-copying everything. Ironically that's exactly the sort of thing SmartCopyTool handles nicely ... or would, if it had filtering by keyword :) The script uses shutils.copy2 to copy files and folders (shutil.copytree uses copy2 internally by default) ... copy2 says it tries to preserve file metadata where possible ... apparently on...
-
Hi Donald, I had forgotten that SmartCopyTool even had filtering by date, to be honest :) I never used to trust the "modified" date in Windows, which is why I didn't use it in the tool at all - I think it has got more reliable over the years though. Seems to make sense for most files in my photo library anyway - arguably more sense than "Created On". I've extended the "filter by date" action to support modification dates as well as creation dates - you can use any combination of created/modified,...
-
Hi Donald, to be honest I had forgotten that SmartCopyTool even had filtering by date :) I never used to trust the modified date in Windows, because it often seemed to be nonsense, but I think it has got more reliable over the years. Seems to make sense for a lot of files in my photo collection anyway - arguably more sense than "Created On". I've extended the filter by date range to support modification dates as well as creation dates - you can use any combination of created/modified before and after....
-
Added filter by modified date.
-
Simon, Wow. Thank you VERY much. I was starting toteach myself Python so I could write the programmyself but it takes more time than I really have sothis is a huge help. Not to look a gift horse in the mouth or seem ungrateful, but could I ask for a couple of what I hope are simple enhancements? First, I need to preserve the original timestampsin the copied data. I was going to use a call torobocopy with the options /COPY:DAT and /DCOPY:T.Is there an equivalent in python? Second, this project is...
-
I need to filter 100,000 files located in 15,000 folders and select all files modified after a certain date. It seems that SmartCopy uses the "Created Date" when filtering by date but I need to filter by "Modified Date". I recently recovered my data from Carbonite after my system became unbootable. Unfortunately, the "path" I used to recover my data caused all files to come back with a "Created Date" of 11/20/2019 and a "Modified Date" of 11/18/2019. Before I noticed this problem I had already begun...
-
No contract necessary, good opportunity to re-acquaint myself with Python: https://github.com/machinewrapped/Toybox/blob/master/Python%20Scripts/CopyFoldersBasedOnKeyword.py To run it you'll need to install Python 3.8 (https://www.python.org/downloads/windows/) and edit the source, target and keyword lines to suit your needs then run the script. You can use Idle, which comes with Python, to edit and run the script. Let me know if you have any issues ... it works OK in my tests but they weren't exactly...
-
Simon, Would you be interested in a quick contract to write such a script? (I don't know Python and don't have time on this project to learn it on the job.). Basically I would need to treewalk a directory structure for folders with names that contain one of a list of keywords (as a substring or a whole word if the folder name contains whitespace). If such a folder is found its entire contents would need to be copied to another drive preserving timestamps and the entire directory structure from the...
-
Hi Richard, sorry - wish that it could but that's beyond SmartCopyTool's abilities I'm afraid. I suspect it would be relatively easy to do what you want with a Python script though, e.g. this is close to what you describe: https://stackoverflow.com/questions/40854483/iteratively-or-recursively-filter-directory-and-copy-results-to-new-directory
-
Hi, I need to identify folders on an 8 TB drive where the folder name contains one of a list of keywords then copy that folder's entire contents to another drive. There are 8.5 million files and folders on the drive so I need to be able to do this in a batch mode. Can SmartCopyTool do this?
-
Home
-
Finally added an option to support deleting or overwriting read-only files, which I've been meaning to do for years.
-
Allow read-only files to be deleted or overwritten
-
garet posted a comment on discussion General Discussion
thnx! will try asap
-
Hi, yes that is the default behaviour if you use "Copy Selected Files" or "Move Selected Files".
-
hi, is there a way to keep the "parent" directory structure? I am looking for something that moves only files while keeping the folder structure so that I don't have to re-built it again and again thnx
-
Added "Flatten" operation
-
Home
-
Added "Flatten Selected Files" operation, which copies all selected files into a target directory without preserving directory structure - i.e. all files will be copied to the same destination folder. If multiple files have the same name a warning will be shown, giving an opportunity to cancel the operation.
-
Hi Mathijs, I think I've been asked for that before... there will be a new version with a "Flatten Files" option uploaded shortly :)
-
Mathijs Groen posted a comment on discussion General Discussion
does the tool support merging of target folders after copying/moving? Ie copy/move all selected files in a folder structure to a single folder?
-
Small update, adds "Select files in selected folders" function, which is hopefully fairly self explanatory.
-
Explanation of Select all files in selected folders function
-
Select all files in selected folders function
-
Fix threading issue on restore selection (primitive fix, add a lock on folder files)
-
Project/App settings
-
Second new version . Support for moving files and folders within the same directory...
-
OK, this is now supported in the latest version! If the destination folder is in...
-
Automatically save and restore selection when r...
-
Uploaded a new version, 1.0.0.4. - Selection is automatically saved and restored...
-
Hi boardtc, your use case isn't currently supported, but could be... since the target...
-
tom corcoran posted a comment on discussion General Discussion
My use case is wanting to move say .mp4 from subolders into another directory. I...
-
Update to latest version
-
Uploaded a new version: - Added 'ignore extension' operation - Fixed crash when selecting...
-
2014-01-23 Added ability to filter files list by date range. Made selection restore...
-
1
