#621 Reopening of "PCManFM is extremely slow on file operations"

1.1
closed-fixed
libfm (303)
5
2012-10-06
2012-10-05
Sworddragon
No

Original ticket: https://sourceforge.net/tracker/?func=detail&aid=3393447&group_id=156956&atid=801864

I'm using now PCManFM 1.0.1 and have tested this again:

>> I'm using PCmanFM 0.9.9 and created a folder of 100.000 files with no
>> content. I created the files with a acript and PCmanFM was in this time
>> acttive in the related directory. The lot of changes forced to use 100% of
>> the cpu time of one core. PCmanFM crashed even after ~2 minutes (maybe
>> because of the lot of refreshes).
>
> The crash doesn't appear anymore but PCManFM needed ~2 minutes until it
> responded again.

There is no change in this. But I have noticed a bad behavior of the memory usage: It increased from 14 MB to 93 MB (which is not the problem). But after leaving the directory the memory usage decreased only from 93 MB to 90 MB.

>> After the creation was finished I opened PCmanFM again and switched to
>> the directory with the files. The loading time was very long and PCmanFM
>> used after this ~95 MB of memory.
>
> The loading time needs a few seconds and the memory usage increased to ~75
> MB.

The memory usage doesn't increase anymore due to the (potential) memory leak (or whatever this is) from the last try. If I'm using a new process the memory usage will increase ~as said before. But leaving the directory again (or even closing the PCManFM window) will not free all the memory.

>> Using Ctrl + A to marking all files and pressing Del to show the delete
>> dialog needed a very long time too. But the deletion process was the
>> heaviest of all. Currently PCManFM uses over 10 minutes of cpu time of one
>> core just for deleting the files. But ls show me that not even one file is
>> in the 10 minutes deleted.
>
> Marking all files with Ctrl + A needs ~1-2 minutes. Pressing Del will
> prompt the deletion dialog instantly. The deletion process still needs a
> lot of cpu time. I have aborted it after ~15 minutes but this time over
> 6000 files were deleted.

Curiously pressing Ctrl + A will mark the files now instantly but opening the deletion prompt with Del will need 1-2 minutes. At least the deletion process has deleted now all 100000 files after ~6 minutes. But I have figured out that the window which shows the deletion process does not update the file which is currently processed.

Here is a short summary:

Bugs:
- On opening a directory with many files the memory usage will increase heavily without being freed.
- The deletion processing window does not update the file which is currently deleted.

Potential Bugs:
- Having the directory opened which will create many files causes PCManFM to not respond for a short while.
- After marking a lot of files if a context menu is opened or the deletion prompt is directly called with Del PCManFM does not respond for a short while.
- The deletion process of many files needs some minutes.

Discussion

  • Lonely Stranger

    Lonely Stranger - 2012-10-06
    • labels: --> libfm
    • milestone: --> 1.1
    • assigned_to: nobody --> lstranger
    • status: open --> closed-fixed
     
  • Lonely Stranger

    Lonely Stranger - 2012-10-06

    > - On opening a directory with many files the memory usage will increase heavily without being freed.

    No memory leaks left in our code, that was tested thoroughly. In regards of non-freed memory - it's default behavior of GLib/Gtk - if memory is allocated then GLib doesn't return it to system but thinks it may be requested again so leaves it allocated. We can do nothing with that, I'm sorry.

    > - The deletion processing window does not update the file which is currently deleted.

    Thank you very much. It's fixed in Git now. Check it when you can.

    > - Having the directory opened which will create many files causes PCManFM to not respond for a short while.

    The scanning of directory with such number of files takes time unfortunately. It takes time even in plain text interface and it's worse when it's GUI as it require not only scan it but render all the icons and texts in view. So it is unavoidable. All possible optimizations were done, it cannot be faster.

    Yet there is another approach - to show files as soon they are found in folder. This will show you first files almost immediately but unfortunately for you due to constant updates showing full directory will take ~30 minutes instead of ~2 minutes (I mean in your example) - that is definitely not what you want. So be patient if you want to use GUI.

    > - After marking a lot of files if a context menu is opened or the deletion prompt is directly called with Del PCManFM does not respond for a short while.

    That is again, due to big number of files and GUI - to show you progress dialog those files should be stocked and calculated before start of actual operation and that takes some time as well.

    > - The deletion process of many files needs some minutes.

    The same here - it takes few tens of seconds in text mode but updating view multiples this time somewhat. All possible optimizations were done already. It cannot be done faster in GUI, I'm sorry.

    Thank you.

     

Log in to post a comment.

Get latest updates about Open Source Projects, Conferences and News.

Sign up for the SourceForge newsletter:





No, thanks