Thread: [popfile-commit] engine/tests TestMailParse.tst, 1.43.4.3, 1.43.4.4 TestNihongo002.wrd, 1.1.2.1, 1

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 422-6466

Update of /cvsroot/popfile/engine/tests
In directory sc8-pr-cvs1.sourceforge.net:/tmp/cvs-serv15410/tests

Modified Files:
      Tag: b0_22_2
	TestMailParse.tst TestNihongo002.wrd TestNihongo006.wrd 
	TestNihongo008.wrd TestNihongo009.wrd TestNihongo010.wrd 
	TestNihongo016.wrd TestNihongo017.wrd TestNihongo021.wrd 
Log Message:
Japanese users now choose the Japanese parser by changing 'bayes_nihongo_parser' option.
Performance improvement for Japanese users.
Decode the encoded attatchment file names.

Index: TestNihongo006.wrd
===================================================================
RCS file: /cvsroot/popfile/engine/tests/Attic/TestNihongo006.wrd,v
retrieving revision 1.1.2.1
retrieving revision 1.1.2.2
diff -C2 -d -r1.1.2.1 -r1.1.2.2
*** TestNihongo006.wrd	21 Feb 2006 13:55:55 -0000	1.1.2.1
--- TestNihongo006.wrd	6 Sep 2007 16:31:41 -0000	1.1.2.2
***************
*** 1,4 ****
--- 1,6 ----
  216.104.176.121 2
+ advance 1
  charset:iso-2022-jp 1
+ current 1
  encoding:base64 1
  from:.ca 1
***************
*** 14,73 ****
  header:Subject 1
  header:To 1
! money 1
  to:.com 1
  to:example.com 1
  to:te...@ex... 1
  £±£± 1
  £±£´ 1
  £²£° 1
! £µ£° 1
  £Ï£Ë 1
  ¤ª¤¹¤¹¤á¤Î 1
  ¤«¤é 4
  ¤¬¤Ê¤¤ 1
  ¤Ç¤â 1
  ¤Ê¤· 1
  ¤Ê¤é 3
  ¤Ë¤Ï¤´ 1
  ¤Þ¤Ç 2
  ¤ì¤Ê¤¤¤¬ 1
  ¥¢¥ë¥Ð¥¤¥È 1
! ¥¥ã¥ó¥Ú¡¼¥ó 1
  ¥µ¥Ý¡¼¥È 1
  ¥µ¥é¥ê¡¼¥Þ¥ó 1
  ¥¹¥Ú¥·¥ã¥ë¥×¥é¥ó 1
  ¥Ç¥ê¥Ð¥ê¡¼¥×¥é¥ó 1
  ¥Ñ¡¼¥È 1
  ¥×¥é¥ó 4
  °Â¿´ 2
  °Ê¾å 1
  °ÊÆâ 1
  ´°Á´ 1
  ´ÊÃ± 1
  ¶¦ÄÌ 1
  ¸½¶â 1
  »î¤· 1
  »þ´Ö 1
  ¼«Âð 1
  ¼Â»Ü 1
  ¼çÉØ 1
  ½Ð¤é 1
! ½÷À 1
  ½÷ÀÀìÍÑ 1
! ¾Ü¤·¤¯ 1
  ¿³ºº 1
  ¿¶¤ê¹þ¤ß 1
  ÁªÂò 1
  Á´¹ñ 1
! Â¨Æü 3
  ÂÎÀ© 1
  Ã´ÊÝ 1
! ÆÃÊÌ 2
  ÇÛÃ£ 1
  ÈëÌ©¸·¼é 1
  É¬Í× 1
  ÉÔÍ× 2
  ÊÝ¾Ú¿Í 1
! Ëü±ß 2
  ÍèÅ¹ 1
  Î©¤Æ 1
--- 16,116 ----
  header:Subject 1
  header:To 1
! money 2
! system 1
  to:.com 1
  to:example.com 1
  to:te...@ex... 1
+ £°£° 2
  £±£± 1
  £±£´ 1
+ £±£¸ 1
  £²£° 1
! £³£° 1
! £µ£° 3
  £Ï£Ë 1
  ¤ª¤¹¤¹¤á¤Î 1
+ ¤¤¤¿¤·¤Þ¤¹ 1
  ¤«¤é 4
  ¤¬¤Ê¤¤ 1
+ ¤¯¤À¤µ¤¤ 1
+ ¤¹¤Ù¤Æ 2
+ ¤½¤Î 3
  ¤Ç¤â 1
  ¤Ê¤· 1
  ¤Ê¤é 3
  ¤Ë¤Ï¤´ 1
+ ¤Î¤ß 1
+ ¤Þ¤»¤ó¤« 1
  ¤Þ¤Ç 2
+ ¤Þ¤Ç¤Ë¤ª 1
+ ¤ß¤Î 1
+ ¤â¤ª 2
+ ¤ë¤È 2
  ¤ì¤Ê¤¤¤¬ 1
+ ¥¢¥Ã¥× 2
+ ¥¢¥É¥Ð¥ó¥¹ 1
  ¥¢¥ë¥Ð¥¤¥È 1
! ¥¥ã¥ó¥Ú¡¼¥ó 4
  ¥µ¥Ý¡¼¥È 1
  ¥µ¥é¥ê¡¼¥Þ¥ó 1
+ ¥·¥¹¥Æ¥à 1
  ¥¹¥Ú¥·¥ã¥ë¥×¥é¥ó 1
  ¥Ç¥ê¥Ð¥ê¡¼¥×¥é¥ó 1
  ¥Ñ¡¼¥È 1
+ ¥Õ¥é¥ó¥Á¥ã¥¤¥º 1
  ¥×¥é¥ó 4
  °Â¿´ 2
  °Ê¾å 1
  °ÊÆâ 1
+ ±Ä¶È»þ´Ö 1
+ ´Ô¸µ 2
  ´°Á´ 1
  ´ÊÃ± 1
+ ¶È¼Ô 1
  ¶¦ÄÌ 1
+ ·î¼ý 1
  ¸½¶â 1
+ ¸Â¤ê 1
+ ¸ÂÄê 1
+ »°ÅÄ 1
  »î¤· 1
+ »þ¤Ë 2
  »þ´Ö 1
  ¼«Âð 1
  ¼Â»Ü 1
  ¼çÉØ 1
+ ¼è¼¡ 1
+ ¼ê¿ôÎÁ 2
  ½Ð¤é 1
! ½÷À 2
  ½÷ÀÀìÍÑ 1
! ¾Ü¤·¤¯ 3
! ¾ì¹ç 2
  ¿³ºº 1
  ¿¶¤ê¹þ¤ß 1
+ ¿½¹þ 1
+ ÀéËü 1
  ÁªÂò 1
  Á´¹ñ 1
! Â¨Æü 5
  ÂÎÀ© 1
+ ÂåÍýÅ¹ 1
  Ã´ÊÝ 1
! ÄÌ¾ï 2
! ÅìµþÅÔÌÜ¹õ¶è 1
! Æ±»þÊç½¸ 1
! ÆÃÊÌ 4
  ÇÛÃ£ 1
+ Èæ¤Ù 2
  ÈëÌ©¸·¼é 1
  É¬Í× 1
  ÉÔÍ× 2
+ ÉéÃ´ 1
+ Ê¿Æü 1
  ÊÝ¾Ú¿Í 1
! Ëè½µ¿åÍËÆü 1
! Ëü±ß 4
! ÌµÎÁ 1
! ÌÜ»Ø¤· 1
  ÍèÅ¹ 1
  Î©¤Æ 1

Index: TestNihongo009.wrd
===================================================================
RCS file: /cvsroot/popfile/engine/tests/Attic/TestNihongo009.wrd,v
retrieving revision 1.1.2.1
retrieving revision 1.1.2.2
diff -C2 -d -r1.1.2.1 -r1.1.2.2
*** TestNihongo009.wrd	21 Feb 2006 13:55:55 -0000	1.1.2.1
--- TestNihongo009.wrd	6 Sep 2007 16:31:41 -0000	1.1.2.2
***************
*** 1,7 ****
! .jp 1
  aaa 1
  charset:iso-2022-jp 4
! click 1
! co.jp 1
  from:.jp 1
  from:co.jp 1
--- 1,6 ----
! .jp 2
  aaa 1
  charset:iso-2022-jp 4
! co.jp 2
  from:.jp 1
  from:co.jp 1
***************
*** 21,26 ****
  html:invalidtag 2
  index 6
! info 1
! inf...@ya... 1
  jst 1
  shift_jis 1
--- 20,24 ----
  html:invalidtag 2
  index 6
! inf...@ya... 2
  jst 1
  shift_jis 1
***************
*** 37,42 ****
  to:te...@ex... 1
  url 1
! yahoo 1
! yahoo.co.jp 1
  zeroro 6
  £È£Ð 1
--- 35,39 ----
  to:te...@ex... 1
  url 1
! yahoo.co.jp 2
  zeroro 6
  £È£Ð 1

Index: TestNihongo010.wrd
===================================================================
RCS file: /cvsroot/popfile/engine/tests/Attic/TestNihongo010.wrd,v
retrieving revision 1.1.2.1
retrieving revision 1.1.2.2
diff -C2 -d -r1.1.2.1 -r1.1.2.2
*** TestNihongo010.wrd	21 Feb 2006 13:55:55 -0000	1.1.2.1
--- TestNihongo010.wrd	6 Sep 2007 16:31:41 -0000	1.1.2.2
***************
*** 1,11 ****
! .jp 2
  beingmail 2
  bestmail 2
! bigtrail 1
! big...@ya... 2
  blat 1
  cbe 1
  charset:iso-2022-jp 2
! co.jp 2
  deleteform 2
  dyndns 2
--- 1,10 ----
! .jp 3
  beingmail 2
  bestmail 2
! big...@ya... 3
  blat 1
  cbe 1
  charset:iso-2022-jp 2
! co.jp 3
  deleteform 2
  dyndns 2
***************
*** 39,44 ****
  ver 1
  winnt's 1
! yahoo 1
! yahoo.co.jp 2
  ¤¢¤ê¤Þ¤»¤ó 1
  ¤¤¤¿¤·¤Þ¤¹ 1
--- 38,42 ----
  ver 1
  winnt's 1
! yahoo.co.jp 3
  ¤¢¤ê¤Þ¤»¤ó 1
  ¤¤¤¿¤·¤Þ¤¹ 1

Index: TestNihongo002.wrd
===================================================================
RCS file: /cvsroot/popfile/engine/tests/Attic/TestNihongo002.wrd,v
retrieving revision 1.1.2.1
retrieving revision 1.1.2.2
diff -C2 -d -r1.1.2.1 -r1.1.2.2
*** TestNihongo002.wrd	21 Feb 2006 13:55:55 -0000	1.1.2.1
--- TestNihongo002.wrd	6 Sep 2007 16:31:41 -0000	1.1.2.2
***************
*** 19,22 ****
--- 19,24 ----
  header:To 1
  mime 1
+ mimeextension:xls 2
+ mimename:_¶¨ÎÏ²ñ¼ÒÍ×°÷¸Ä¿Í¥¹¥¥ë¾ðÊó_3907 1
  multi 1
  mydns.jp 1

Index: TestNihongo008.wrd
===================================================================
RCS file: /cvsroot/popfile/engine/tests/Attic/TestNihongo008.wrd,v
retrieving revision 1.1.2.1
retrieving revision 1.1.2.2
diff -C2 -d -r1.1.2.1 -r1.1.2.2
*** TestNihongo008.wrd	21 Feb 2006 13:55:55 -0000	1.1.2.1
--- TestNihongo008.wrd	6 Sep 2007 16:31:41 -0000	1.1.2.2
***************
*** 1,3 ****
! .jp 2
  charset:iso-2022-jp 1
  encoding:7bit 1
--- 1,3 ----
! .jp 3
  charset:iso-2022-jp 1
  encoding:7bit 1
***************
*** 23,36 ****
  header:X-UIDL 1
  jst 1
! ne.jp 2
! subject:xfb 1
  to:.jp 1
  to:ne.jp 1
  to:xxx.ne.jp 1
  to:xx...@xx... 1
! xxx 3
! xxx.ne.jp 1
! xxxx 1
! xx...@xx... 1
  xx...@ez... 1
  xxxxxxxx 2
--- 23,34 ----
  header:X-UIDL 1
  jst 1
! ne.jp 3
  to:.jp 1
  to:ne.jp 1
  to:xxx.ne.jp 1
  to:xx...@xx... 1
! xxx 2
! xxx.ne.jp 2
! xx...@xx... 2
  xx...@ez... 1
  xxxxxxxx 2

Index: TestNihongo017.wrd
===================================================================
RCS file: /cvsroot/popfile/engine/tests/Attic/TestNihongo017.wrd,v
retrieving revision 1.1.2.1
retrieving revision 1.1.2.2
diff -C2 -d -r1.1.2.1 -r1.1.2.2
*** TestNihongo017.wrd	21 Feb 2006 13:55:55 -0000	1.1.2.1
--- TestNihongo017.wrd	6 Sep 2007 16:31:41 -0000	1.1.2.2
***************
*** 5,15 ****
  #ff00ff 1
  #ff9900 6
! .jp 29
  .org 2
! 18kin.jp 29
  av.18kin.jp 24
  charset:iso-2022-jp 3
! delmail 1
! de...@18... 3
  dvd 2
  e-dm.org 2
--- 5,14 ----
  #ff00ff 1
  #ff9900 6
! .jp 30
  .org 2
! 18kin.jp 30
  av.18kin.jp 24
  charset:iso-2022-jp 3
! de...@18... 4
  dvd 2
  e-dm.org 2
***************
*** 19,23 ****
  from:18kin.jp 1
  from:de...@18... 1
! from:£±£¸¶Øjapan 1
  header:Content-Transfer-Encoding 2
  header:Content-Type 2
--- 18,23 ----
  from:18kin.jp 1
  from:de...@18... 1
! from:£±£¸¶Ø 1
! from:japan 1
  header:Content-Transfer-Encoding 2
  header:Content-Type 2
***************
*** 53,57 ****
  japan 2
  jst 1
! kin 2
  news 4
  subject:test 1
--- 53,57 ----
  japan 2
  jst 1
! kin 1
  news 4
  subject:test 1

Index: TestNihongo021.wrd
===================================================================
RCS file: /cvsroot/popfile/engine/tests/Attic/TestNihongo021.wrd,v
retrieving revision 1.1.2.1
retrieving revision 1.1.2.2
diff -C2 -d -r1.1.2.1 -r1.1.2.2
*** TestNihongo021.wrd	21 Feb 2006 13:55:55 -0000	1.1.2.1
--- TestNihongo021.wrd	6 Sep 2007 16:31:41 -0000	1.1.2.2
***************
*** 1,9 ****
! .jp 1
  12.235.202.19 1
  alias 1
  charset:iso-2022-jp 3
! co.jp 1
! dareka 1
! dokoka 2
  dokokanohost 1
  encoding:7bit 1
--- 1,10 ----
! .jp 2
  12.235.202.19 1
  alias 1
  charset:iso-2022-jp 3
! co.jp 2
! da...@do... 1
! dokoka 1
! dokoka.co.jp 1
  dokokanohost 1
  encoding:7bit 1

Index: TestMailParse.tst
===================================================================
RCS file: /cvsroot/popfile/engine/tests/TestMailParse.tst,v
retrieving revision 1.43.4.3
retrieving revision 1.43.4.4
diff -C2 -d -r1.43.4.3 -r1.43.4.4
*** TestMailParse.tst	24 Feb 2006 10:33:33 -0000	1.43.4.3
--- TestMailParse.tst	6 Sep 2007 16:31:41 -0000	1.43.4.4
***************
*** 549,556 ****
--- 549,558 ----
  if ( $have_text_kakasi ) {
      $b->module_config_( 'html', 'language', 'Nihongo' );
+     $b->config_( 'nihongo_parser', 'kakasi' );
      $b->{parser__}->mangle( $w );
      $b->initialize();
      test_assert( $b->start() );
      $cl->{lang__} = 'Nihongo';
+     $cl->setup_nihongo_parser( 'kakasi' );
  
      # Test decode_string
***************
*** 573,577 ****
      # Test kakasi wakachi-gaki
  
!     $cl->init_kakasi();
  
      my $wakati_string = pack( "H*", "504f5046696c6520a4cf20bcabc6b020a5e1a1bca5eb20bfb6a4eacaaca4b120a5c4a1bca5eb20a4c7a4b9" );
--- 575,579 ----
      # Test kakasi wakachi-gaki
  
!     $cl->{nihongo_parser__}{init}();
  
      my $wakati_string = pack( "H*", "504f5046696c6520a4cf20bcabc6b020a5e1a1bca5eb20bfb6a4eacaaca4b120a5c4a1bca5eb20a4c7a4b9" );
***************
*** 582,586 ****
      test_assert_equal( $cl->parse_line_with_kakasi($original_string), $wakati_string );
  
!     $cl->close_kakasi();
  
      # parse test for Japanese e-mails.
--- 584,588 ----
      test_assert_equal( $cl->parse_line_with_kakasi($original_string), $wakati_string );
  
!     $cl->{nihongo_parser__}{close}();
  
      # parse test for Japanese e-mails.

Index: TestNihongo016.wrd
===================================================================
RCS file: /cvsroot/popfile/engine/tests/Attic/TestNihongo016.wrd,v
retrieving revision 1.1.2.1
retrieving revision 1.1.2.2
diff -C2 -d -r1.1.2.1 -r1.1.2.2
*** TestNihongo016.wrd	21 Feb 2006 13:55:55 -0000	1.1.2.1
--- TestNihongo016.wrd	6 Sep 2007 16:31:41 -0000	1.1.2.2
***************
*** 5,15 ****
  #ff00ff 1
  #ff9900 6
! .jp 28
  .org 1
! 18kin.jp 28
  av.18kin.jp 24
  charset:iso-2022-jp 2
! delmail 1
! de...@18... 2
  dvd 1
  e-dm.org 1
--- 5,14 ----
  #ff00ff 1
  #ff9900 6
! .jp 29
  .org 1
! 18kin.jp 29
  av.18kin.jp 24
  charset:iso-2022-jp 2
! de...@18... 3
  dvd 1
  e-dm.org 1
***************
*** 18,22 ****
  from:18kin.jp 1
  from:de...@18... 1
! from:£±£¸¶Øjapan 1
  header:Content-Transfer-Encoding 1
  header:Content-type 1
--- 17,22 ----
  from:18kin.jp 1
  from:de...@18... 1
! from:£±£¸¶Ø 1
! from:japan 1
  header:Content-Transfer-Encoding 1
  header:Content-type 1
***************
*** 51,55 ****
  japan 1
  jst 1
- kin 1
  news 2
  subject:test 1
--- 51,54 ----