Menu

#2 segv on 4cpu with large input file

open
nobody
None
5
2009-03-27
2009-03-27
Greylander
No

Calling gtksort as below causes a segmentation error on a 4 cpu machine with 8G of ram, with input file size of ~2G (exactly 1984915025 bytes).

gtksort -i infile -o outfile -f -b -z 25 -k 1,4,i32 -k 7,10,i32 -k 11,12,i16

The error does not occur on small files (not sure where the cutoff is).

There error also is prevented by the -m option, as in

gtksort -i infile -o outfile -f -b -z 25 -k 1,4,i32 -k 7,10,i32 -k 11,12,i16 -m 512

Discussion

  • Greylander

    Greylander - 2009-03-27

    Additional info: the error happens immediately -- so likely during initialization, or immediately after.

     
  • Greylander

    Greylander - 2009-03-27

    One more thing: The error also did not happen with only two sort keys, as in:

    gtksort -i infile -o outfile -f -b -z 25 -k 1,4,i32 -k 7,10,i32

     
  • Lucas Tsatiris

    Lucas Tsatiris - 2009-04-07

    @graylander:

    I need more information on this. What is you OS? What version of gtksort did you use?

    Thanks a lot

     

Log in to post a comment.

MongoDB Logo MongoDB