Menu

#245 Very slow performance when analyzing changes over network shares

All versions
closed-fixed
O. Givi
1
2015-12-20
2014-01-09
jbit byte
No

I've been using DirSyncPro in Ubuntu for years and I perceived this great tool to have acceptable performance.

I switched my desktop (Intel i5) from Ubuntu to Windows last week and I detected severe performance problems in DirSyncPro.

Here is the situation that I found:
1. I have a network shared drive (NAS SMB) that I sync with my desktop local drive.
2. I configure master files in NAS (Dir B) and I copy to desktop (Dir A), so typical configuration is "Mirror B->A"
3. Performance results in Ubuntu 12.04 and DirSyncPro 1.44
- Analyze 5900 files, 693 folders in 1:27
- Analyze 45639 files, 384 folders in 6:15
- Analyze 58763 files, 1628 folders in 3:35
4. Perfomance results in Windows 7 and DirSyncPro 1.44
- Analyze 2250 files, 328 dirs in 10:16
5. Perfomance results in Windows 7 and DirSyncPro 1.46 (same dataset as v1.44)
- Analyze 3375 files, 492 dirs in 10:44 (there should be 2250 files, but this is a DirSyncPro bug)
6. Perfomance results in Windows 7 and DirSyncPro 1.47b4 (same dataset as v1.44)
- Analyze 2250 files, 330 dirs in 11:17

As you can observe, there is a HUGE difference in DirSyncPro performance when comparing Windows 7 against Ubuntu (Ubuntu much faster). DirSyncPro has similar performance across versions, but there is something that is not going well compared to Ubuntu.

I believe that performance problem might be related to the way DirSyncPro retrieves file information for network drives, one by one (significant network latency for each retrieved file), instead of retrieving at-once a large list of files in the current directory that is being processed.

Is there any way to improve the performance of DirSyncPro when using network drives?

Discussion

  • O. Givi

    O. Givi - 2014-01-10
    • status: open --> pending
     
  • O. Givi

    O. Givi - 2014-01-10

    Hi,

    Please download version 1.47b4 and give it a try. There are lots of performance enhancements implemented in 1.47.

    Looking forward to hearing your test results.

    Kind regards,
    Omid

     
  • jbit byte

    jbit byte - 2014-01-10

    Hi Omid.
    I already did testing by using 1.47b4 (see bullet number 6 into my initial post).
    I did the test in two ways:
    - Executing DirSyncPro.exe (compiled version, Windows 7)
    - Executing dirsyncpro.jar with java jre 1.7.0_45-b18 (Java HotSpot(TM) Client VM (build 24.45-b08, mixed mode, sharing))
    In both cases I got similar results for same dataset (11:10 to 11:20 per analysis of 2250 files & 330 dirs)
    Best regards. Jbit

     
  • Bill

    Bill - 2014-07-29

    I just upgraded from 1.48 to 1.49 and find the analysis part to be much faster now.

     
  • O. Givi

    O. Givi - 2015-12-20
    • status: pending --> closed-fixed
     

Log in to post a comment.