[popfile-commit] engine stopwords,1.7,1.8

[<jgr...@us...>]

Update of /cvsroot/popfile/engine
In directory sc8-pr-cvs1:/tmp/cvs-serv17979

Modified Files:
	stopwords 
Log Message:
Fix bug 826765

@ and $ inside magnets were not being handled properly.

Classifer/Bayes.pm:

Factor most of magnet_match__ into magnet_match_helper__ so
that there is no duplicated code.  Remove use of regexps for
magnet match and replace with simple 'eq' matching, thus
eliminating all the complexities around special characters 
in regexps and the fact that @ and $ are illegal in \Q \E
quoted regexps.

tests/TestBayes.tst:

Added tests for magnet_match__ with specific emphasis on
handling of $ and @.

Made Japanese tests detect whether Text::Kakasi is present
on the machine and ignore them (with a warning if it is
not present).





















Index: stopwords
===================================================================
RCS file: /cvsroot/popfile/engine/stopwords,v
retrieving revision 1.7
retrieving revision 1.8
diff -C2 -d -r1.7 -r1.8
*** stopwords	28 Oct 2003 01:06:46 -0000	1.7
--- stopwords	28 Oct 2003 19:39:48 -0000	1.8
***************
*** 1,11 ****
- strike
  you
  date
- textflow
  form
  him
  pdt
- also
  code
  acronym
  pst
--- 1,11 ----
  you
+ strike
  date
  form
+ textflow
  him
  pdt
  code
+ also
  acronym
  pst
***************
*** 14,23 ****
  cgi
  charset
- nbsp
  est
  sun
  your
- but
  title
  and
  multicol
--- 14,23 ----
  cgi
  charset
  est
+ nbsp
  sun
  your
  title
+ but
  and
  multicol
***************
*** 30,38 ****
  being
  dir
- she
  jan
  color
- will
  have
  received
  going
--- 30,38 ----
  being
  dir
  jan
+ she
  color
  have
+ will
  received
  going
***************
*** 40,50 ****
  htm
  edt
- can
- mbox
  height
! dfn
  iframe
! were
  com
  would
  off
--- 40,50 ----
  htm
  edt
  height
! mbox
! can
  iframe
! dfn
  com
+ were
  would
  off
***************
*** 67,89 ****
  aug
  overlay
- div
  www
  status
  doing
  tue
  person
- his
- cellspacing
  mon
! select
  helo
  esmtp
- header:from
  alt
- header:From
- note
- border
- message
  wbr
  big
  thu
--- 67,87 ----
  aug
  overlay
  www
+ div
  status
  doing
  tue
  person
  mon
! cellspacing
! his
  helo
+ select
  esmtp
  alt
  wbr
+ message
+ border
+ note
  big
  thu
***************
*** 129,168 ****
  body
  nobr
- bgcolor
  html
  from
  var
- her
  oct
  banner
  del
- math
  blockquote
! path
  any
  spot
- textarea
  cdt
! the
  embed
  done
  yet
  it's
- font
  net
! blink
  thead
  plaintext
- could
  went
  does
  param
- jul
  this
  org
- for
- mailto
- src
  mar
  cst
  kbd
--- 127,166 ----
  body
  nobr
  html
+ bgcolor
  from
  var
  oct
+ her
  banner
  del
  blockquote
! math
  any
+ path
  spot
  cdt
! textarea
  embed
+ the
  done
  yet
  it's
  net
! font
  thead
+ blink
  plaintext
  went
+ could
  does
  param
  this
+ jul
  org
  mar
+ src
+ mailto
+ for
  cst
  kbd
***************
*** 175,186 ****
  helvetica
  samp
- been
- tab
  col
  fig
  mail
  cite
- link
  had
  script
  menu
--- 173,184 ----
  helvetica
  samp
  col
+ tab
+ been
  fig
  mail
  cite
  had
+ link
  script
  menu
***************
*** 190,196 ****
  ins
  sep
- was
  sub
! frameset
  sat
  apr
--- 188,194 ----
  ins
  sep
  sub
! was
  sat
+ frameset
  apr