[Crm114-announce] New version- EXPERIMENTAL - CRM114-20060209-ReaverSecondBreakfast

[Bill Y <ws...@me...>]

There's a new Seekrit Version on the website: crm114-20060209-ReaverSecondBreakfast.  I'll run a few more QC things on it before we put it up publicly
on the website.

Get it at:

 http://crm114.sourceforge.net/crm114-20060209-ReaverSecondBreakfast.src.tar.gz


Here's the blurb:


This is the transition release to the new "Reaver" format for storing
and caching the learned texts.  The "Reaver" format keeps all incoming
mail in a maildir-like cache (but _not_ your maildir; we don't touch
that, and if you don't use maildir, that's just fine).  The advantage
is that the incoming mail is saved exactly as it needs to be trained,
and a CacheID is added to the mail that you finally see.

As long as the CacheID header is intact, you can just reference this
stored copy (assuming it hasn't been purged away) You say "use the
cached text" with --cache for command line users as in:

    bash:   crm mailfilter.crm --cache --learnspam < text_with_cacheid_header

or (for mail-to-myself users - forward to yourself with the CacheID
header intact):

    command my_secret_password learnspam cache

and you will train *exactly* the text should be trained, with no worry
as to whether something in the system added headers, deleted
suspicious text, or whatever.  The "Reaver" cache hardlinks your
trained data into "known spam" and "known nonspam" subdirectories, so
even when the cache gets purged, you don't lose training data.

Note that the :thickness: parameter now is meaningful!  Anything
scoring less than this amount (plus or minus) is tagged as UNSURE
and will be delivered along the "good" mail path with the extra
header of "Please train me!"  Default thickness is 10 pR units, which
gives really good results for me.

Another advantage of the Reaver cache is that you can use
mailtrainer.crm to run advanced training (like DSTTTR) on the full
contents of your "known" and "probably" directories, to get really
fast accurate .css files.  After testing, we've changed the defaults
on mailtrainer to only do one pass of DSTTTR.

Notes to MeetTheReavers users who have already used mailtrainer.crm -
we've added the --reload option and the default repeat count is now
1 pass (rather than 5).

Checksums:

md5sum crm114-20060209-ReaverSecondBreakfast.*.tar.gz

7ff472caddd9f667e67137c565ad528d  crm114-20060209-ReaverSecondBreakfast.i386.tar.gz
438c73dd16e9e5af97eadc32b010e85c  crm114-20060209-ReaverSecondBreakfast.src.tar.gz

Enjoy....

	-Bill Yerazunis