Bill Torpey

On Dec 2, 2022, at 10:26 AM, Mark Seger markseger@users.sourceforge.net wrote: I think you may be confused about collectl data collection. When you collect process data your get a lot more than is displayed. You can then play it back multiple times and choose to display different process options from same collection, see --helpsuboopts. Also, no need to run once to collectl process data and a second time for system disk or other data. Just collectl it all in one go and play back with --vmstat or...

Sorry if that wasn't clear: we run collectl once to get per-process cpu utilization (--procopts kw4096 -sZ -oDG), a second time to get per-process memory utilization (--procopts mkw4096 -sZ -oDG), a third time to get system-wide network utilization (-sN -oD), and fourth to get vmstat (--export vmstat -oD). All of that is from the same .raw file(s). Again, we did it that way just so we could run both collectl and our old monitoring tools and compare like-for-like. We'll be changing that to generate...

Thanks Laurence, I'll check that out. FWIW, attached is the kind of output we get from vmstat.

Hi Mark (and Laurence): First off, thanks for all the help, and for a great tool! Please see replies inline below: Bill - I guess the one overall question I'd ask is about your general use of collectl and why you have a handful of smallisk files you need to play back together and also way none of your files are compressed? We've recently switched to collectl for monitoring our QA performance testing environment, with a view to rolling out collectl in production. collectl is replacing a bunch of custom...

Right -- you're just removing the check for "-s". I've been running with that patch in my local copy for a week or so and have not seen any problems. Looks good to me! and Thanks!

Here's the directory listing: [btorpey@bt-brix7 collectl]$ ls -lh *.raw -rw-r--r-- 1 btorpey shared 102M Nov 22 09:36 csappia01-20221110-223734.raw -rw-r--r-- 1 btorpey shared 2.0G Nov 22 09:36 csappia01-20221111-000000.raw -rw-r--r-- 1 btorpey shared 2.0G Nov 22 09:36 csappia01-20221112-000000.raw -rw-r--r-- 1 btorpey shared 1.1G Nov 22 09:36 csappia01-20221113-000000.raw The result of running the system collectl: [btorpey@bt-brix7 collectl]$ time /usr/bin/collectl -p '*.raw' --export vmstat -oD...

Hi -- I'm back... Have run some tests, and my results seem to indicate that: Without quotes, wildcarding the "-p" param results in only the first file being processed (bash guarantees that filenames are returned in alpha order) With quotes, collectl processes all files, subject to "--from" parameter It doesn't matter whether you use single or double quotes Presence/absence of "--from" parameter makes no difference. Except with "--export vmstat": collectl will NOT process multiple files -- at the...

Hi -- I'm back... Have run some tests, and my results seem to indicate that: Without quotes, wildcarding the "-p" param results in only the first file being processed (bash guarantees that filenames are returned in alpha order With quotes, collectl processes all files, subject to "--from" parameter It doesn't matter whether you use single or double quotes Presence/absence of "--from" parameter makes no difference. Except with "--export vmstat": collectl will NOT process multiple files -- at the end...