OK. This is a special RC hence the 0 because it's the first time I've built POPFile with all Brian's changes, and a fresh VMWare of Win2K, so there could be trouble.
Let me know how it goes. Brian, I'm particularly looking for feedback from you. Junya, there's no Japanese support in this installer... that will be in RC1 (which will be a proper RC).
John.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Just installed this as an upgrade to the previous release on my production corpus.
Conversion took only 3/4 of a minute. This is excellent in my opinion.
The first message I received after the upgrade was this announcement and it was unclassified. Every message I have received from this forum has always been classified. Something has changed here. I assume it has something to do the accuracy drop topic. I don't expect any issues ina day or two.
One thing that I think needs to be looked at is the change to my Subject Header Modification settings. I had all of these turned off and the upgrade turned them all on.
Speed looks good too. Clicking through the tabs and looking at mail in the interface is quite snappy. It seems no slower than the previous version!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
No problems here with classification after the upgrade to RC0. But when I went from Test_5 to Test_6 last week I found a large number of message misclassified the next morning. At that point I decided that my corpus should probably be dumped and rebuilt from scratch - the .db file was almost 20MB, and the corpus had been through every upgrade of PF since I first installed it in December 2002.
It took a while to re-train to close to my previous accuracy - I've been resetting the stats about every thousand messages, and here's how the percentages went on each group:
95.07, 97.40, 98.32, 99.13, 99.46, 99.28, 99.04 (received some once-a-week messages on Monday morning which had to be reclassified).
I reset again after this install. So far running 100% on 54 messages :-)
Bill
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
> OK. This is a special RC hence the 0 because it's the first time I've built
> POPFile with all Brian's changes, and a fresh VMWare of Win2K, so there could
> be trouble.
Yes! But not much.
Anticipating that this version would revert to the normal POPFile directory in Program Files, I copied POPFileTest to POPFile, then ran the installation.
First problem, the release notes didn't display - just a blank notepad screen. Tried re-starting the install, same thing.
As I expected, the installer pointed itself to C:\Program Files\POPFile, which I accepted. The installer found the Test installation and asked if I wanted to upgrade; this also set the user data location to the same folder. The Corpus Conversion window is excellent; showed progress reports on my three buckets.
After the install completed PF started successfully, but my stats, which were at 191 messages classified with 1 error, now show 0 messages classified with 1 error.
Subject Header Modification, which I had turned off, was turned on for all buckets.
Otherwise running fine and fast.
Bill
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Okay... Something went very wrong with the install. All of my buckets have zero words in them now, even after 5 reclassifications. I am going to check install directories, but I have never used anything but default in the past.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Updated my wife's installation of v 0.19.0 (yes, that old) using RC0.
Was confused about two things;
1) the installer did not recognize her existing installation, it wanted to install to program files\popfile. I had to browse to \popfile to get it to recognize the existing install.
2) It asked me about overwriting popfile.cfg. Even as a seasoned user, I was confused about how to answer that one. If I say yes, does that mean I loose my existing configuration? If I say no, will my configuration get upgraded?
3) I was upgrading, so why was I asked to configure mail clients? It was unclear to me if I would mess up her existing configuration if I said yes.
The corpus conversion took 23 minutes. When it finished, I went to the UI and clicked the buckets tab. No words, zero word count.
She's gonna kill me. Good thing she is out of town <g>. Gotta go figure out what went wrong.....
Scott
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
OK, I'm confused. How has anyone successfully converted?
The upgrade logic is calling put_value__, which requires a wordid, but we are passing it the actual word. Looks to me like no-one should have every been able to upgrade their corpus.
Scott
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Ahh, I feel much better. All fixed and the wife's POPFile is now running nicely under v 0.21.0.
Just notice her stats, 41975 messages, 32 errors, 99.92% accuracy. Better than mine and she doesn't do any tweaking or anything, just reclassifies when she sees a mistake.
Scott
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
>>the installer did not recognize her existing installation<<
It looks like the installer does not check the registry to see if there is any clue there about earlier versions of POPFile. That is something I can fix (it used to do this check; looks like I made one improvement too many here).
>>It asked me about overwriting popfile.cfg<<
In fact it was asking for permission to overwrite the BACKUP COPY of popfile.cfg. I've been thinking about removing this message as I thought it was no longer necessary. Thanks for bringing it to my attention.
>>I was upgrading, so why was I asked to configure mail clients? It was unclear to me if I would mess up her existing configuration if I said yes<<
The installer cannot be sure if the user wants to reconfigure again (the only way to be sure is to look through all the accounts). So the installer always offers to reconfigure the accounts. No changes are made unless checkboxes are ticked.
One of the changes for 0.21.0 is that the installer now displays every account it finds, even if it cannot be reconfigured for POPFile. For Outlook Express and Outlook the installer also generates a text file listing all the accounts found (this is to help debug the new code).
On the page which lists the email clients detected, the button to the left of "Next" is labelled "Skip All" - if you click this the installer will not offer to reconfigure any email accounts and go straight to the "Start POPFile" page.
All of the Outlook Express, Outlook and Eudora reconfiguration pages have a similar button (labelled "Skip Client") which cancels the reconfiguration of that particular client
Brian
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I clicked on the Shutdown POPFile link so I could restore my backup, but it didn't completely shutdown apparently. I cannot delete the directory and I cannot find any processes that are still running. I am going remove POPFile from the startup group and reboot and restore my older copy.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I started PF from the new shortcut on the Start menu, and Task Manager shows wperl.exe running.
But the shortcut in the Startup folder still points to POPFileTest and runpopfile.exe. I edited it to POPFile and popfile.exe and will restart Windows after posting this.
Bill
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
OK, now I restarted WinXP and the new PF just won't run. Correcting my previous post, the Startup shortcut now points to POPFile\runpopfile.exe. PF didn't run on startup, won't start from the Start menu, nor from the PF folder directly. The UI won't connect, and Task Manager shows nothing running.
I reverted to Test_7, which is running OK.
Bill
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
runpofile.exe always calls popfile.exe but the popfile.exe shipped with 0.21.0RC0 does not work. If you rename popfile.exe and then make a copy of popfileib.exe (or one of the other popfile*.exe programs) and call it popfile.exe then your Start Menu shortcuts should work.
Brian
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I might be wrong, but I don't think runpopfile.exe is supposed to be used. I thought it was just for testing since Brian couldn't build a real popfile.exe.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
OK. This is a special RC hence the 0 because it's the first time I've built POPFile with all Brian's changes, and a fresh VMWare of Win2K, so there could be trouble.
It's here:
http://popfile.sf.net/setup-0.21.0-RC0.exe
Let me know how it goes. Brian, I'm particularly looking for feedback from you. Junya, there's no Japanese support in this installer... that will be in RC1 (which will be a proper RC).
John.
Just installed this as an upgrade to the previous release on my production corpus.
Conversion took only 3/4 of a minute. This is excellent in my opinion.
The first message I received after the upgrade was this announcement and it was unclassified. Every message I have received from this forum has always been classified. Something has changed here. I assume it has something to do the accuracy drop topic. I don't expect any issues ina day or two.
One thing that I think needs to be looked at is the change to my Subject Header Modification settings. I had all of these turned off and the upgrade turned them all on.
Speed looks good too. Clicking through the tabs and looking at mail in the interface is quite snappy. It seems no slower than the previous version!
I've now had 5 "unclassified" messages in a row. Four from this forum and one from Red Hat. None of these has ever been misclassified before.
No problems here with classification after the upgrade to RC0. But when I went from Test_5 to Test_6 last week I found a large number of message misclassified the next morning. At that point I decided that my corpus should probably be dumped and rebuilt from scratch - the .db file was almost 20MB, and the corpus had been through every upgrade of PF since I first installed it in December 2002.
It took a while to re-train to close to my previous accuracy - I've been resetting the stats about every thousand messages, and here's how the percentages went on each group:
95.07, 97.40, 98.32, 99.13, 99.46, 99.28, 99.04 (received some once-a-week messages on Monday morning which had to be reclassified).
I reset again after this install. So far running 100% on 54 messages :-)
Bill
jgrahamc wrote:
> OK. This is a special RC hence the 0 because it's the first time I've built
> POPFile with all Brian's changes, and a fresh VMWare of Win2K, so there could
> be trouble.
Yes! But not much.
Anticipating that this version would revert to the normal POPFile directory in Program Files, I copied POPFileTest to POPFile, then ran the installation.
First problem, the release notes didn't display - just a blank notepad screen. Tried re-starting the install, same thing.
As I expected, the installer pointed itself to C:\Program Files\POPFile, which I accepted. The installer found the Test installation and asked if I wanted to upgrade; this also set the user data location to the same folder. The Corpus Conversion window is excellent; showed progress reports on my three buckets.
After the install completed PF started successfully, but my stats, which were at 191 messages classified with 1 error, now show 0 messages classified with 1 error.
Subject Header Modification, which I had turned off, was turned on for all buckets.
Otherwise running fine and fast.
Bill
Installation notes were blank here too... forgot to mention that in my post.
Okay... Something went very wrong with the install. All of my buckets have zero words in them now, even after 5 reclassifications. I am going to check install directories, but I have never used anything but default in the past.
I guess I'd better write some!
John.
>>The Corpus Conversion window is excellent<<
I wish the rest of the installer was as good as this <g>
Brian
Updated my wife's installation of v 0.19.0 (yes, that old) using RC0.
Was confused about two things;
1) the installer did not recognize her existing installation, it wanted to install to program files\popfile. I had to browse to \popfile to get it to recognize the existing install.
2) It asked me about overwriting popfile.cfg. Even as a seasoned user, I was confused about how to answer that one. If I say yes, does that mean I loose my existing configuration? If I say no, will my configuration get upgraded?
3) I was upgrading, so why was I asked to configure mail clients? It was unclear to me if I would mess up her existing configuration if I said yes.
The corpus conversion took 23 minutes. When it finished, I went to the UI and clicked the buckets tab. No words, zero word count.
She's gonna kill me. Good thing she is out of town <g>. Gotta go figure out what went wrong.....
Scott
Well, the words are in words.
Matrix has entries, but not one single entry has a wordid. Every wordid is null.
Scott
OK, I'm confused. How has anyone successfully converted?
The upgrade logic is calling put_value__, which requires a wordid, but we are passing it the actual word. Looks to me like no-one should have every been able to upgrade their corpus.
Scott
Well, that was a completely wrong diagnosis. That's what I get for reading too quickly and not thinking.
Anyways, removing the # PROFILE STARTs and STOPs fixes it. I'm converting her corpus now in the foreground with no Perl warnings this time.
She'll never know how messed up I had her POPFile <g>.
Scott
That's incorrect, the upgrade code does work correctly, we even have tests for it :-)
John.
In case you didn't create a backup first, the installer is supposed to have copied the old corpus to Backup\nonsql. I hope you get it worked out.
Yeah, I see it. The conversion code in bayes.pm needs some work.
No big deal (as long as I get it fixed before she returns on the 13th <g>).
Man am i glad I didn't do this when she was here. I would never have heard the end of it.
Scott
Ahh, I feel much better. All fixed and the wife's POPFile is now running nicely under v 0.21.0.
Just notice her stats, 41975 messages, 32 errors, 99.92% accuracy. Better than mine and she doesn't do any tweaking or anything, just reclassifies when she sees a mistake.
Scott
>>the installer did not recognize her existing installation<<
It looks like the installer does not check the registry to see if there is any clue there about earlier versions of POPFile. That is something I can fix (it used to do this check; looks like I made one improvement too many here).
>>It asked me about overwriting popfile.cfg<<
In fact it was asking for permission to overwrite the BACKUP COPY of popfile.cfg. I've been thinking about removing this message as I thought it was no longer necessary. Thanks for bringing it to my attention.
>>I was upgrading, so why was I asked to configure mail clients? It was unclear to me if I would mess up her existing configuration if I said yes<<
The installer cannot be sure if the user wants to reconfigure again (the only way to be sure is to look through all the accounts). So the installer always offers to reconfigure the accounts. No changes are made unless checkboxes are ticked.
One of the changes for 0.21.0 is that the installer now displays every account it finds, even if it cannot be reconfigured for POPFile. For Outlook Express and Outlook the installer also generates a text file listing all the accounts found (this is to help debug the new code).
On the page which lists the email clients detected, the button to the left of "Next" is labelled "Skip All" - if you click this the installer will not offer to reconfigure any email accounts and go straight to the "Start POPFile" page.
All of the Outlook Express, Outlook and Eudora reconfiguration pages have a similar button (labelled "Skip Client") which cancels the reconfiguration of that particular client
Brian
I clicked on the Shutdown POPFile link so I could restore my backup, but it didn't completely shutdown apparently. I cannot delete the directory and I cannot find any processes that are still running. I am going remove POPFile from the startup group and reboot and restore my older copy.
Codestuff Starter is showing these entries:
C:\Program Files\POPFile\popfile.exe
C:\Program Files\POPFile\runpopfile.exe /startup
I think the first one should have been removed during install.
I started PF from the new shortcut on the Start menu, and Task Manager shows wperl.exe running.
But the shortcut in the Startup folder still points to POPFileTest and runpopfile.exe. I edited it to POPFile and popfile.exe and will restart Windows after posting this.
Bill
OK, now I restarted WinXP and the new PF just won't run. Correcting my previous post, the Startup shortcut now points to POPFile\runpopfile.exe. PF didn't run on startup, won't start from the Start menu, nor from the PF folder directly. The UI won't connect, and Task Manager shows nothing running.
I reverted to Test_7, which is running OK.
Bill
runpofile.exe always calls popfile.exe but the popfile.exe shipped with 0.21.0RC0 does not work. If you rename popfile.exe and then make a copy of popfileib.exe (or one of the other popfile*.exe programs) and call it popfile.exe then your Start Menu shortcuts should work.
Brian
And that's all my fault: popfile.exe wasn't taking into account POPFILE_ROOT.
John.
I might be wrong, but I don't think runpopfile.exe is supposed to be used. I thought it was just for testing since Brian couldn't build a real popfile.exe.