Work at SourceForge, help us to make it a better place! We have an immediate need for a Support Technician in our San Francisco or Denver office.

Close

#150 store cache data in binary form.

open
nobody
Performance (7)
5
2012-03-29
2006-02-05
Kuang-che Wu
No

This small patch let pisg use Storable to do caching
instead Data::Dumper. It stores cache data in binary
form instead of text.

Comparison with the original cache and the new one:
I run pisg with 4 channels x 1400 days log (one per
day), total 6.5M lines.
CPU time reduce from 132s to 87s.
Memory usage reduce from 23mb to 20mb.
Disk space from 209M to 154M.

Discussion

  • Kuang-che Wu
    Kuang-che Wu
    2006-02-05

     
    Attachments
  • Christoph Berg
    Christoph Berg
    2006-02-09

    Logged In: YES
    user_id=304233

    Hi,
    thanks for the patch. I'm swamped with work at the moment,
    so it might take some time until I can have a look at it,
    but this sounds very interesting.
    Christoph
    (If someone else wants to try it, I'm curious to head feedback!)

     
  • Koepi
    Koepi
    2006-07-06

    Logged In: YES
    user_id=1550312

    Hi,

    thanks for this nice patch.
    generating time before 18m 12s
    now 14m 24s

    greets Koepi

     
  • Logged In: NO

    how do I use this patch file? Which file does it patch?