mupip extract performance

Help
2011-01-06
2012-12-29
  • George James
    George James
    2011-01-06

    I'm running a mupip extract -format=binary for a very large global.

    Monitoring the performance while it's running I don't see any cpu utilisation, no iowait and quite modest disk write rate.  There's nothing else running on the system so there's no other competition for resources.

    What's the resource bottleneck?  I'd expect disk IO to be the limiting factor but it doesn't seem to be.  Is there anything that will make mupip extract run faster?

     
  • Edwin Clubb
    Edwin Clubb
    2011-01-06

    I have always found mupip extract to be cpu bound.  Be sure to display cpu utilization for all cores when using a tool such as top - mupip only runs on one core, so total cpu usage for a system with dual quad processors and hyperthreading (16 virtual cores) would only show around 5-6% utilization.

     
  • George James
    George James
    2011-01-06

    CPU is virtually 0% on all cores.

    I don't understand why a binary extract would be CPU bound.  It can't be doing much more than reading blocks and writing them to the output file. 

     
  • Edwin Clubb
    Edwin Clubb
    2011-01-06

    I failed to notice the binary format specifier, which as you say, should just be dumping the blocks to the file .  Have you tried the default ZWR format to see how it compares?  Also, have you tried writing the output file to disk or partition separate from where the GT.M .dat file resides?