Sorry, I have no idea why it was not 5.0 GHz. All visible programs are closed, only a command line window is open. Maybe some background service? Kaspersky Antivirus?
All the results are attached. Let me know, If I should execute anything else for you.
PS There seems to be an error trying 3072m (Allocation ERROR: 1450) for the second test.
It's slightly unusual results in lp.txt.
It looks like the memory is strongly fragmented with 4 KB pages by some reason. So 7-Zip can't allocate large pages after 3 GB.
Also it doesn't use 1 GiB pages at all.
When did you reboot the system last time?
Maybe there was some unusual memory consumption process after reboot?
Please run all these benchmark commands again after reboot.
Please write also about memory timings.
Last edit: Igor Pavlov 2019-12-08
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Some days ago. Now it seems the lp part runs fine even with larger pages.
I have also added the specs of my machine (report from CPU-Z tool including memory timings).
Thanks!
Actually your lp.txt result before reboot shows that Windows 10 in your case can't restore good state to get big number of 2 MB memory pages. It could not allocate more than 2.5 GB from 32 GB total before reboot.
Now I don't know why it's so. Maybe the kernel or some drivers or user programs allocate 4KB pages that can't be moved to another places. So there is big fragmentation for these 4 KB physical pages.
I want to enable large pages by default in 7-Zip for all users. And it's not good that some systems can't allocate large pages as it was in your case before reboot. So 7-Zip will have to use more slow 4 KB pages in such cases.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
There is a problem with 64 thread default limitation in Windows.
And I don't see simple solution now.
There are drawbacks for any solution, as I suppose.
But it's not actual problem still. And 99.9% desktop computers in Windows have less than 65 threads still.
Also if you use more than 64 threads, it's low probabilty that all these threads will be utilized by 7-Zip.
In your case it's not so bad that 7-Zip uses only one CPU from two CPUs. That way you will not get the performance loss when thread in one cpu reads data from another socket.
You can try to disable some cores in BIOS, and get only 32 cores and 64 threads.
Probably then 7-Zip will use them all.
So you can compare the performance of 32 cores in two sockets and 18 cores in one socket.
Probably the 7-Zip benchmark will be faster in case of 32 cores.
But real life use cases for 7-Zip can be good enough in one socket with 18 cores.
Last edit: Igor Pavlov 2019-12-23
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Dear Igor,
first of all, I want to thank you (and your team) for this incredible tool.
It is the best compression tool by far (in terms of compression time vs compression ratio).
But I have a question. Why is the dictionary size limited at all?
I have 32 GB of RAM, so my dictionary could be far larger than the 1.5 GB (around 3GB would work with 32 GB, I noticed that the ratio is around 1:11).
Could you increase the dictionary size to 3 GB at least ?
Thanks!
Last edit: Hurry 2020-01-05
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Sorry, I have no idea why it was not 5.0 GHz. All visible programs are closed, only a command line window is open. Maybe some background service? Kaspersky Antivirus?
All the results are attached. Let me know, If I should execute anything else for you.
PS There seems to be an error trying 3072m (Allocation ERROR: 1450) for the second test.
Last edit: Peter 2019-12-08
It's slightly unusual results in
lp.txt.It looks like the memory is strongly fragmented with 4 KB pages by some reason. So 7-Zip can't allocate large pages after 3 GB.
Also it doesn't use 1 GiB pages at all.
When did you reboot the system last time?
Maybe there was some unusual memory consumption process after reboot?
Please run all these benchmark commands again after reboot.
Please write also about memory timings.
Last edit: Igor Pavlov 2019-12-08
Some days ago. Now it seems the lp part runs fine even with larger pages.
I have also added the specs of my machine (report from CPU-Z tool including memory timings).
Thanks!
Actually your lp.txt result before reboot shows that Windows 10 in your case can't restore good state to get big number of 2 MB memory pages. It could not allocate more than 2.5 GB from 32 GB total before reboot.
Now I don't know why it's so. Maybe the kernel or some drivers or user programs allocate 4KB pages that can't be moved to another places. So there is big fragmentation for these 4 KB physical pages.
I want to enable large pages by default in 7-Zip for all users. And it's not good that some systems can't allocate large pages as it was in your case before reboot. So 7-Zip will have to use more slow 4 KB pages in such cases.
Attention!
Windows 7 running under VirtualBox 6.0
i7-3540m notebook
win10 1809 17763.316
Ryzen 7 3700X 1.0.0.4B
32GB DDR4 3200 (2X16GB)
Windows 10 64-bit 1909 (18363.535)
My (uninteresting) Pentium 4
Ryzen 9 3900x
Hi Igor,
Here comes the log from more "workflow" oriented set-up (2x physical Intel(R) Xeon(R) Gold 6154 CPU).
I have noticed, that 7zip cannot detect (neither utilize) all 72 logical processors. Can it be, that this is due to the "+64 logical processors" aspect:
https://docs.microsoft.com/da-dk/windows/win32/api/sysinfoapi/nf-sysinfoapi-getlogicalprocessorinformation?redirectedfrom=MSDN
I have attached some additional information about the set-up used for the test (including part of CPU-Z report), that may help debugging this.
Best regards
Michal
Last edit: Michal Powalko 2019-12-19
There is a problem with 64 thread default limitation in Windows.
And I don't see simple solution now.
There are drawbacks for any solution, as I suppose.
But it's not actual problem still. And 99.9% desktop computers in Windows have less than 65 threads still.
Also if you use more than 64 threads, it's low probabilty that all these threads will be utilized by 7-Zip.
In your case it's not so bad that 7-Zip uses only one CPU from two CPUs. That way you will not get the performance loss when thread in one cpu reads data from another socket.
You can try to disable some cores in BIOS, and get only 32 cores and 64 threads.
Probably then 7-Zip will use them all.
So you can compare the performance of 32 cores in two sockets and 18 cores in one socket.
Probably the 7-Zip benchmark will be faster in case of 32 cores.
But real life use cases for 7-Zip can be good enough in one socket with 18 cores.
Last edit: Igor Pavlov 2019-12-23
Intel i5-7600K on up-to-date Windows 10 x64.
7-Zip 19.02 alpha (x64)
Windows 10.0 18362
Intel(R) Core(TM) i5-9600K CPU @ 3.70GHz
i5-3210M
This one is from an old Haswell i7-4510U. It's strange that AES256CBC:3 lines are blank, this CPU has 2 cores but 4 threads.
AES256CBC:3 is avx-256 AES (VAES) supported only by new Intel's Ice Lake processors.
Intel Skull Canyon NUC6i7KYK
Intel(R) Core(TM) i7-6770HQ CPU @ 2.60GHz
Windows 10.0 18363
Dear Igor,
first of all, I want to thank you (and your team) for this incredible tool.
It is the best compression tool by far (in terms of compression time vs compression ratio).
But I have a question. Why is the dictionary size limited at all?
I have 32 GB of RAM, so my dictionary could be far larger than the 1.5 GB (around 3GB would work with 32 GB, I noticed that the ratio is around 1:11).
Could you increase the dictionary size to 3 GB at least ?
Thanks!
Last edit: Hurry 2020-01-05
There are some limitations, that require some changes in code and additional testing.
I plan to increase the dictionary later.
Skylake i7-6500U
Is this version now safe for daily use? Or are there errors/problems?
Last edit: Sander Bouwhuis 2020-01-08
safe
Thanks for the reply, and HUGE thanks for the best archiver available!
Where can I find 7za.exe v1902? It's not in the archive of the first comment of this forum thread.
Last edit: Sander Bouwhuis 2020-01-09
Intel Celeron N2940
GUI :
7ZFM -> Pop-Menu -> Open Inside / Open Inside * / Open Inside #
CUI:
How can i use 7Z to List/Extract with Open Inside / Open Inside * / Open Inside # ?
Thank you .