Sanmayce

Command line options for MAX compression

Failed to extract/test .bz2 of Chinese Wikipedia

Hi Igor, here some feedback comes from my laptop 'Compressionette': https://github.com/facebook/zstd/issues/2551#issuecomment-808213083

Thanks for the fopen64 workaround, but the issue remains unaddressed! So maximal size of read per attempt is on 32-bit 2^32-1, and on 64-bit 2^64-1 bytes Obviously, not in practice, so in order to avoid problems documentations should state this issue.

I am pretty sure that our fread/fwrite routines work pretty well. Kai, I'm using MinGW packages that have certainly that problem, are you 100% sure yours is working with e.g. 2+GB in one go?! Still cannot figure out where the problem is, added the return value: if ((fp = fopen(argv[1], "rb")) == NULL) { printf("Nakamichi: Can't open '%s' file.\n", argv[1]); exit(13); } ... BUG_totalREAD = fread(SourceBlock, 1, SourceSize, fp); // Bug in MinGW, 2020-Oct-01 fclose(fp); According to https://man7.org/linux/man-pages/man3/fread.3.html...

For what is worth the OS is Windows 7 Pro, also the quick checking of a textual file shows the GCC binary works "PROPERLY": D:\Satanichi_aka_Nakamichi_2020-Jun-09>dir 06/11/2020 09:16 AM 55,397 lzsse2.cpp 06/11/2020 09:16 AM 1,316,439 Nakamichi_Ryuugan-ditto-1TB_btree.c 09/06/2019 11:50 AM 969,050,128 NCBI_FTP_Homo_sapiens_(human)_GCA_000001405.28_GRCh38.p13_genomic.fna.Nakamichi 06/15/2019 02:37 AM 3,313,087,324 q 01/07/2018 05:26 PM 191,644 Satanichi_GCC730_64bit.exe 06/11/2020 09:16 AM 198,144...

The same said the GCC guy in the link above: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=97215#c4 (In reply to Andrew Pinski from comment #2) You need b if you don't want \r\n to be turned into just \n. At 11,945th line I use: if ((fp = fopen(argv[1], "rb")) == NULL) { printf("Nakamichi: Can't open '%s' file.\n", argv[1]); exit(13); } 1] As far as I investigated, the problem is that fread() reads less (around 860 bytes) than specified. 2] Also, as I wrote: This bug never appeared with files 1GB...

The same said the GCC guy in the link above: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=97215#c4 (In reply to Andrew Pinski from comment #2) You need b if you don't want \r\n to be turned into just \n. At 11,945th line I use: if ((fp = fopen(argv[1], "rb")) == NULL) { printf("Nakamichi: Can't open '%s' file.\n", argv[1]); exit(13); } 1] As far as I investigated, the problem is that fread() reads less (around 860 bytes) than specified. 2] Also, as I wrote: This bug never appeared with files 1GB...