Hi All!
There is a good news.
ASSP successfully passed rebuild on fresh installation of Windows 2008 SP2 with all updates, Perl v5.14.2 with all modules updates and clean ASSP install
Also I've tried to run rebuildspam at last ASSP 2.2.2 build 12174 and succeed.
It looks like some Microsoft update for Windows 2003 Server interfere with perl or some perl module causing access violation.
It's a little strange cause I tried on 3 different server with Windows 2003 server installed and rebuildspam has failed on them with the same error.
Best regards
Alexander Shabalin
From: Shabalin, Alexander
Sent: Friday, June 22, 2012 11:20 AM
To: 'Thomas Eckardt'
Subject: Re: [Assp-test] Rebuild crashes perl
Nope:
The only thing assp says before die
Jun-22-12 10:42:09 [Worker_10000] Error: MainThread stuck for 123 seconds after: MainLoop start poll Sockets - last debug step was: mainloop before restart check!
And I think this is has done while DrWatson snapshotting crashed thread.
BTW. After I stop Error Reporting Service ASSP has processed about 1000 spam mail and then died.
I checked again and this time assp died immediately after rebuild starts. Rebuilddebug.txt says that is checked only 2 files.
I've tried clean install on Windows 2008 SP2 x86 without any perl and system updates - successful rebuild.
Today I'm plan to install all updated to the system then check again. After that I'll install updates on all perl modules and run rebuild once again.
I'll mail results as soon as I have any results.
Best regards
Alexander Shabalin
From: Thomas Eckardt [mailto:Thomas.Eckardt@...]
Sent: Friday, June 22, 2012 9:03 AM
To: Shabalin, Alexander
Subject: Antwort: RE: Antwort: Re: [Assp-test] Rebuild crashes perl
Alexander,
please try the attached. There are no special settings required.
An scheduler Bug is fixed, which could cause the crash - tell me if it works.
Thomas
Von: "Shabalin, Alexander" <AShabalin@...>
An: Thomas Eckardt <Thomas.Eckardt@...>,
Datum: 21.06.2012 11:42
Betreff: RE: Antwort: Re: [Assp-test] Rebuild crashes perl
________________________________________
C:\>perl -e "use Digest::MD5; print Digest::MD5::md5_hex('abc');"
900150983cd24fb0d6963f7d28e17f72
C:\>perl -e "use Win32::Unicode;"
C:\>perl -e "use Lingua::Stem::Snowball;"
C:\>perl -e "use Lingua::Identify;"
C:\>perl -e "use Lingua::StopWords;"
I've tried to run perl assp.pl under my admin user with full access rights to assp and perl folders. No effect.
I have a very little knowledge of perl. Maybe you can say what function is processing every mail so I add some output to console after every line to look where crash is happened.
Best regards
Alexander Shabalin
-----Original Message-----
From: Thomas Eckardt [mailto:Thomas.Eckardt@...]
Sent: Wednesday, June 20, 2012 9:14 PM
To: Shabalin, Alexander
Subject: Antwort: Re: [Assp-test] Rebuild crashes perl
>DrWatson says:
Application exception occurred:
App: C:\Perl\bin\perl.exe (pid=5708)
When: 19.06.2012 @ 17:11:49.425
Exception number: c0000005 (access violation)
Looks like the user has no permission to any of the required files in assp/ib or Perl 'c0000005 (access violation)' - or a XS file for a module is missing.
The rebuild uses the following modules:
Digest::MD5
Win32::Unicode
Lingua::Stem::Snowball
Lingua::Identify
Lingua::StopWords
BerkeleyDB or DB_File
File::Copy
IO::Handle
IO::Socket
Encode
warnings
Because the crash appears at file access, I think 'Digest::MD5' could be the reason - assp calculates a MD5 hash for each mail body to identify identical mails.
But also any of
Win32::Unicode
Lingua::Stem::Snowball
Lingua::Identify
Lingua::StopWords
could cause the crash.
You can disable any or all of the above modules, except 'Digest::MD5' - this is part of the base Perl distro and must be available!
check with : perl -e "use Digest::MD5; print Digest::MD5::md5_hex('abc');"
C:\>perl -e "use Digest::MD5; print Digest::MD5::md5_hex('abc');"
900150983cd24fb0d6963f7d28e17f72
C:\>
Thomas
Von: "Shabalin, Alexander" <AShabalin@...>
An: ASSP development mailing list <assp-test@...>,
Kopie: Victor Miasnikov <vvm@...>, Thomas Eckardt <Thomas.Eckardt@...>
Datum: 20.06.2012 12:33
Betreff: Re: [Assp-test] Rebuild crashes perl
Hi!
I've tried to set
ASSP_AFCDetectSpamAttachRe:=
and have no positive result.
I even tried to remove plugin from Plugins folder with no result.
Clean install Perl v5.14.2, updating modules and clean install ASSP has
the same effect - crash when rebuild starts.
I'll try to install new virtual server with Windowd 2008 SP2 x32 and try
again.
I'll write down here in any case at the end or experiment.
Also I've tried to disable SMTP as recommend Thomas and run
perl assp.pl
Console output:
[skipped startup init and move to num]
Jun-20-12 13:50:03 [Worker_10001] C:/assp/errors/spam
Jun-20-12 13:50:03 [Worker_10001] File Count: 2
Jun-20-12 13:50:03 [Worker_10001] Processing... errors/spam with 2 files
Jun-20-12 13:50:03 [Worker_10001] Ignore files older than Sep-24-09
13:50:03 in folder errors/spam
Jun-20-12 13:50:03 [Worker_10001] Imported Files: 0
Jun-20-12 13:50:03 [Worker_10001] Finished in 1 second(s)
Jun-20-12 13:50:03 [Worker_10001] C:/assp/errors/notspam
Jun-20-12 13:50:03 [Worker_10001] File Count: 2
Jun-20-12 13:50:03 [Worker_10001] Processing... errors/notspam with 2
files
Jun-20-12 13:50:03 [Worker_10001] Ignore files older than Sep-24-09
13:50:03 in folder errors/notspam
Jun-20-12 13:50:03 [Worker_10001] Imported Files: 0
Jun-20-12 13:50:03 [Worker_10001] Finished in 1 second(s)
Jun-20-12 13:50:03 [Worker_10001] C:/assp/spam
Jun-20-12 13:50:03 [Worker_10001] File Count: 9,926
Jun-20-12 13:50:03 [Worker_10001] Processing... spam with 9,926 files
C:\assp>
----------
rebuilddebug.txt output:
Jun-20-12 13:50:03 C:/assp/errors/spam
Jun-20-12 13:50:03 File Count: 2
Jun-20-12 13:50:03 Processing... errors/spam with 2 files
Jun-20-12 13:50:03 ignore files older than Sep-24-09 13:50:03 in folder
errors/spam
Jun-20-12 13:50:03 Imported Files: 0
Jun-20-12 13:50:03 Finished in 1 second(s)
Jun-20-12 13:50:03 C:/assp/errors/notspam
Jun-20-12 13:50:03 File Count: 2
Jun-20-12 13:50:03 Processing... errors/notspam with 2 files
Jun-20-12 13:50:03 ignore files older than Sep-24-09 13:50:03 in folder
errors/notspam
Jun-20-12 13:50:03 Imported Files: 0
Jun-20-12 13:50:03 Finished in 1 second(s)
Jun-20-12 13:50:03 C:/assp/spam
Jun-20-12 13:50:03 File Count: 9,926
Jun-20-12 13:50:03 Processing... spam with 9,926 files
Jun-20-12 13:50:09 file (1): C:/assp/spam/1.eml
Best regards
Alexander Shabalin
From: Victor Miasnikov [mailto:vvm@...]
Sent: Wednesday, June 20, 2012 11:50 AM
To: Thomas Eckardt
Cc: Shabalin, Alexander
Subject: Fw: ASSP v2.2.2(12169) Fw: Re: ASSP_AFCDetectSpamAttachRe:= Re:
Try turn off new feature ( . . .) related with calculation md5 sum. of
attachment[s] ( primary images, .pdf , .zip ) Re: [ Assp - test ] Rebuild
crashes perl Fw: 27968-47007 [Worker_1]
Hi!
> Then all other files one by one. And perl is going down after each file.
This can be related ASSP_AFCDetectSpamAttachRe ?
Best regards, Victor Miasnikov
Blog: http://vvm.blog.tut.by/
----- Original Message -----
From: "Victor Miasnikov" vvm (at) tut.by
To: "Shabalin, Alexander"
Sent: Wednesday, June 20, 2012 10:42 AM
Subject: ASSP v2.2.2(12169) Fw: Re: ASSP_AFCDetectSpamAttachRe:= Re: Try
turn off new feature ( . . .) related with calculation md5 sum. of
attachment[s] ( primary images, .pdf , .zip ) Re: [ Assp - test ] Rebuild
crashes perl
Hi!
> Jun-19-12 20:40:03 Processing... spam with 9,926 files
> Jun-19-12 20:40:09 file (1): C:/assp/spam/0.eml
>
> After deleting 0.eml I've getting the same with the next file
>
> Jun-19-12 20:45:48 Processing... spam with 9,926 files
> Jun-19-12 20:45:54 file (1): C:/assp/spam/1.eml
>
> Then all other files one by one. And perl is going down after each file.
Please, check this in Youre enviroment:
==
try
ASSP_AFCDetectSpamAttachRe:=
( this turn off "Check .MD5 of .img" )
==
==
After I set
ASSP_AFCDetectSpamAttachRe:=
rebuildspam stopped crashed
==
See in
P.P.S.
Best regards, Victor Miasnikov
Blog: http://vvm.blog.tut.by/
> PS. Sorry for my poor English.
Donn't worry: Normal English :-)
----- Original Message -----
From: "Shabalin, Alexander"
To: "ASSP development mailing list"
Sent: Tuesday, June 19, 2012 8:32 PM
Subject: Re: [Assp-test] Rebuild crashes perl
> Jun-19-12 20:40:03 Processing... spam with 9,926 files
> Jun-19-12 20:40:09 file (1): C:/assp/spam/0.eml
>
> After deleting 0.eml I've getting the same with the next file
>
> Jun-19-12 20:45:48 Processing... spam with 9,926 files
> Jun-19-12 20:45:54 file (1): C:/assp/spam/1.eml
>
> Then all other files one by one. And perl is going down after each file.
>
>
> Best regards
> Alexander Shabalin
P.P.S.
----- Original Message -----
From: "Victor Miasnikov" vvm (at) tut.by
To: "Grayhat"Sent: Friday, March 02, 2012 5:38 PM
Subject: Re: ASSP_AFCDetectSpamAttachRe:= Re: Try turn off new feature ( .
.. .) related with calculation md5 sum. of attachment[s] ( primary images,
..pdf , .zip ) Re: [Assp-test] fixes in assp 2.1.2 build 12058
. . .
After I set
ASSP_AFCDetectSpamAttachRe:=
rebuildspam stopped crashed
Please, check this in Youre enviroment
Best regards, Victor Miasnikov
Blog: http://vvm.blog.tut.by/
----- Original Message -----
From: "Grayhat"
To: "Victor Miasnikov" vvm (at) tut.by
Sent: Friday, March 02, 2012 5:22 PM
Subject: Re: ASSP_AFCDetectSpamAttachRe:= Re: Try turn off new feature ( .
.. .) related with calculation md5 sum. of attachment[s] ( primary images,
..pdf , .zip ) Re: [Assp-test] fixes in assp 2.1.2 build 12058
>
>> ASSP_AFCDetectSpamAttachRe:=
>
> No such a thing; as I wrote, I *removed* the plugings (stopped ASSP,
> renamed them from ".pm" to ".pm.bak") so ASSP doesn't even load them
> and there's NO trace of them in the assp.cfg file; again, I suspect
> it's something *inside* ASSP; probably some branch path related to
> HMM (even if it's disabled)
--
----- Original Message -----
From: "Victor Miasnikov" vvm (at) tut.by
To: "Colin"; "ASSP development mailing list"
Sent: Friday, February 03, 2012 10:16 AM
Subject: 1) Try turn off .Check .MD5 of .img by set
ASSP_AFCDetectSpamAttachRe:= Y) Turn on debug Z) problem not related
unicode_in_filenames feature? Or related? Re: [Assp-test] Rebuildspamdb
problems
. . .
> Where ASSP fails, the ASSP process just stops running.
> No errors, no dumps or anything.
> My monitoring script detects this and starts ASSP back up again.
If
ASSP_AFCDetectSpamAttachRe:=image\/
try
ASSP_AFCDetectSpamAttachRe:=
( this turn off "Check .MD5 of .img" )
. . .
Best regards, Victor Miasnikov
----- Original Message -----
From: "Thomas Eckardt" <Thomas.Eckardt@...>
To: "Victor Miasnikov" <vvm@...>
Sent: Thursday, April 19, 2012 3:04 PM
Subject: Antwort: $webAdminPort = _ _ ; {= Douglas Fraser : this covers
the situation where $webAdminPort has both a IP address and a port number
Fw: [Assp-user] Reporting a bug? Fw: 27968-47007 [Worker_1]
. . .
_
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no known virus in this email!
*******************************************************
|