Re: [Assp-user] HMMdb empty in analyze report?

[Jay <he...@he...>]

Alright never mind I found out why the report comes up with the HMM as 
empty. So here's what I found, HMMusesBDB is ON by default. We are using 
MYSQL as our DB backend. Looking through the documentation under 
Bayesian/HMM options is where I found this option. We have spamdb set to 
DB: and DBdriver set to mysql. So this is the case where the default 
setting is working against me. I have a suggestion, if you have spamdb 
set to DB: and DBdriver is not set to use the BerkleyDB as the driver, 
then the setting HMMusesBDB should really be logged somewhere either in 
the rebuild log or maillog indicating a conflict. I really think this 
would help people out in the future.

Anyways, disregard my previous posts.

On 10/28/2015 11:29 AM, Jay wrote:
> Another bit of information I found, looking at the ASSP folder, the 
> last time a copy of the HMMdb file has a date/time stamp on it was 
> 10/26/2015. Which is the day I turned the BerkleyDB back on for the 
> spamdb rebuild after mentioning our rebuild would die in the middle of 
> the process. Looking at my revision history on our server I turned the 
> BerkleyDB for rebuild back to ON per Thomas' suggestion after the last 
> date/time stamp of the HMMdb. So there is definitely something really 
> weird here. A copy of the spamdb is in the ASSP folder from the 
> rebuild from this morning but not the HMMdb. Any clue as to why?
>
> On 10/28/2015 10:59 AM, Jay wrote:
>> Alright this is kind of puzzling to me. We are using ASSP version 
>> 2.4.5(15162) and also using MYSQL for our database backend. When I 
>> send a request to ASSP for analyzing an email I get a weird response 
>> back in the email. I get the Bayesian analysis back just fine, but 
>> the HMM is blank. DoBayesian and DoHMM are both set to score in my 
>> config. Under the section for Hidden-Markov-Model Spam probabilities 
>> the results come back as follows:
>>
>> *combined HMM spam probability*:     got no result because the HMM 
>> database is empty
>> *HMM confidence*:     0.00000000
>> *corpus confidence*:     1.00000000
>>
>>
>> Which is really odd, here's the last section of my rebuild from this 
>> morning:
>>
>> Oct-28-15 07:15:58 Spam Weight:       8,312,860
>> Oct-28-15 07:15:58 Not-Spam Weight:   8,314,034
>>
>> Oct-28-15 07:15:58 Corpus norm:    0.9999 - (very good - balanced)
>> Oct-28-15 07:15:58 Corpus confidence:    1.00000000
>>
>> Oct-28-15 07:16:03 Start populating Hidden Markov Model. HMM-check is 
>> disabled for this time!
>> Oct-28-15 07:16:03 start populating Hidden Markov Model with 
>> 4,282,658 records!
>> Oct-28-15 07:16:46 Finished populating Hidden Markov Model with 
>> 4,282,658 records!
>> Oct-28-15 07:16:46 Finished populating Hidden Markov Model. HMM-check 
>> is now enabled again!
>>
>> We recently switched our rebuild to use the BerkleyDB for rebuilding 
>> the spamdb. Here's a snippet from the top of my rebuilddebug.txt file:
>>
>> Oct-28-15 06:00:00 rebuild debug output is enabled to 
>> c:/assp/rebuilddebug.txt
>> Oct-28-15 06:00:00 RebuildSpamDB uses BerkeleyDB for temporary hashes
>> Oct-28-15 06:00:00 RebuildSpamDB uses BerkeleyDB-ENV with 50.00 MByte
>> Oct-28-15 06:00:00 RebuildSpamDB-thread rebuildspamdb-version 7.11 
>> started in ASSP version 2.4.5(15162)
>> Oct-28-15 06:00:00 RebuildSpamDB will create a Hidden Markov Model
>>
>> So is there something I am missing here? I seem to remember that 
>> before we switched to the BerkleyDB for rebuild the HMM section 
>> populated information just fine. Now the report claims the HMMdb is 
>> blank. Is there something wrong with the BerkleyDB rebuild?
>>
>> Here's the version we are using for the BerkleyDB: (Directly from the 
>> ASSP email interface)
>> BerkeleyDB     0.51 / 0.42     enabled
>> BerkeleyDB_DBEngine     5.3 / 4.5     enabled
>>
>>
>>
>> ------------------------------------------------------------------------------ 
>>
>>
>>
>> _______________________________________________
>> Assp-user mailing list
>> Ass...@li...
>> https://lists.sourceforge.net/lists/listinfo/assp-user
>>
>>
>> -----
>> No virus found in this message.
>> Checked by AVG - www.avg.com
>> Version: 2015.0.6173 / Virus Database: 4455/10903 - Release Date: 
>> 10/28/15
>
>
>
>
> ------------------------------------------------------------------------------
>
>
> _______________________________________________
> Assp-user mailing list
> Ass...@li...
> https://lists.sourceforge.net/lists/listinfo/assp-user
>
>
> -----
> No virus found in this message.
> Checked by AVG - www.avg.com
> Version: 2015.0.6173 / Virus Database: 4455/10903 - Release Date: 10/28/15