Is it possible to use the same corpus and installation with both POP3 and the IMAP module at the same time?
I ask because my setup is like this:
I fetch my mail at home with POP3, but during the day I check my account from work using IMAP. I receive about 500 spam mails/day making it pretty difficult to sort out the valid emails in my IMAP client when I'm at work... Therefore I'd like POPFile to use the corpus (built from POP3) and check my account through IMAP, moving the (suspected) spam to a separate IMAP folder. The added plus is that I won't have to download the spam through POP when I'm at home - I only need to check the POPfile interface and/or the spam IMAP folder once in a while for improper classifications...
I tried to enable IMAP on my POPfile installation at home (0.22.1-1 on Debian sarge) but I never got it working, and I figured that it might be a limitation that isn't documented anywhere... If it's not, I'll try again. :)
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
There is no reason why having both IMAP and POP3 enabled shouldn't work. It works for me.
From your description I wasn't able to understand completely how you are trying to set it up (which machine will run POPFile, e.g.). If one of your computers is online 24/7, you can do without POP3 and rely completely on IMAP.
Let me know how things turn out,
Manni
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I don't use IMAP exclusively because I prefer to have the messages on disk for quick access. Besides, I store tens of thousands of message, which would bring my IMAP server (which is also located overseas) to a halt. :/
The IMAP.pm file isn't included in the Debian package for some reason, so I'll try to install it from the source file and enable it in the advanced settings... Is anything else required to enable the module?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I don't think that you need anything else. If I'm wrong, perl will tell you about any missing modules.
You cannot use the current cvs version of Services/IMAP.pm, you will need (I think) version 1.9 which you can download here: http://cvs.sourceforge.net/viewcvs.py/\*checkout*/popfile/engine/Services/IMAP.pm?rev=1.9
Manni
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Ok, got it working now using 1.9 that you suggested. Thanks again!
What happened now (just like last time I tried) was that the "mail bucket X to folder Y" list on the configuration page didn't show up immediately after entering the mail server configuration. It did show up a after a while though, odd.
BTW, the config page tells me that "You cannot map more than one bucket to a single folder!" which is a little odd since it works fine for me at work (where I use POPfile on Windows with IMAP), but it seems to work like I want despite the error message.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
> he "mail bucket X to folder Y" list
> on the configuration page didn't
> show up immediately after entering
> the mail server configuration
It isn't supposed to. Thus what you experienced was a case of "behavior by design" ;-)
That's why we have that "Refresh folders now" button.
> but it seems to work like I
> want despite the error message.
When the error message appears then the setting your were trying to apply isn't applied. I suggest you double-check your settings and make sure that your output folders are really the ones you'd like to use. You _can_ map more than one bucket to a single folder _only_ if one of the buckets is the unclassified folder. Everything else is a bug.
Manni
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
the problem with more then one bucket mapped to a single folder is that the reclassification-on-move doesn't know what bucket you intended to reclassify the message as when you move it to that folder
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I use the imap/pop3 configuration of popfile where imap is used for preliminary checking and classifying of all domain mailbox collected in providers part.
The interval for imap checking is 3 minutes. Every 15 minutes my pop3recv agent picks up the rest of Inbox and transfer it to our mail-server for local tossing.
Now pop3recv is used for direct connection to providers mailbox so if the box is busy with popfile imap communications I even don't know whether it is possible to receive smth at the same time. Besides, the situation is possible when the mailbox contains some new mail and pop3recv picks it up before imap module start checking so the spam will be passed to the end user. My question - is there some way to synchronize the sequence or make some flag to be sure that all income mail are checked by imap before it is allowed to be picked up by pop3-receiver.
Another way is to serialize imap with pop3 setting the pop3recv agent to use popfile proxy instead of directly access the provider's box. But here is still some desynchronization possible.
Your ideas are welcome.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
the problem is that you have two completely independant programs accessing your mailbox. as such there is no easy way to avoid the race conditions that you are describing.
instead of useing pop3recv to fetch your messages and store them locally can you find something that uses IMAP (fetchmail will do this for example). then instead of leaving the non-spam messages in the inbox, have them moved to another folder and fetch from that folder, that way you will only fetch messages that popfile has processed and moved (and the move should be atomic, no chance of getting a partial message unless you have a defective IMAP server)
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Yes, I have already clarified it with provider's support. Communigate Pro allows to pick up mails from any chosen subfolder even for pop3 client. It is enough to add name of the folder before account name like checked#postmaster if "checked" is subfolder with clean mail. Fetchmail could be implemented too, thank you for smart suggestion.
The only unclear point is with reclassifying feedback to imap folders. Please see my message in adjacent topic.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Is it possible to use the same corpus and installation with both POP3 and the IMAP module at the same time?
I ask because my setup is like this:
I fetch my mail at home with POP3, but during the day I check my account from work using IMAP. I receive about 500 spam mails/day making it pretty difficult to sort out the valid emails in my IMAP client when I'm at work... Therefore I'd like POPFile to use the corpus (built from POP3) and check my account through IMAP, moving the (suspected) spam to a separate IMAP folder. The added plus is that I won't have to download the spam through POP when I'm at home - I only need to check the POPfile interface and/or the spam IMAP folder once in a while for improper classifications...
I tried to enable IMAP on my POPfile installation at home (0.22.1-1 on Debian sarge) but I never got it working, and I figured that it might be a limitation that isn't documented anywhere... If it's not, I'll try again. :)
You will have to try it again ;-)
There is no reason why having both IMAP and POP3 enabled shouldn't work. It works for me.
From your description I wasn't able to understand completely how you are trying to set it up (which machine will run POPFile, e.g.). If one of your computers is online 24/7, you can do without POP3 and rely completely on IMAP.
Let me know how things turn out,
Manni
Thanks for your feedback, I'll try again!
I don't use IMAP exclusively because I prefer to have the messages on disk for quick access. Besides, I store tens of thousands of message, which would bring my IMAP server (which is also located overseas) to a halt. :/
The IMAP.pm file isn't included in the Debian package for some reason, so I'll try to install it from the source file and enable it in the advanced settings... Is anything else required to enable the module?
I don't think that you need anything else. If I'm wrong, perl will tell you about any missing modules.
You cannot use the current cvs version of Services/IMAP.pm, you will need (I think) version 1.9 which you can download here:
http://cvs.sourceforge.net/viewcvs.py/\*checkout*/popfile/engine/Services/IMAP.pm?rev=1.9
Manni
Ok, got it working now using 1.9 that you suggested. Thanks again!
What happened now (just like last time I tried) was that the "mail bucket X to folder Y" list on the configuration page didn't show up immediately after entering the mail server configuration. It did show up a after a while though, odd.
BTW, the config page tells me that "You cannot map more than one bucket to a single folder!" which is a little odd since it works fine for me at work (where I use POPfile on Windows with IMAP), but it seems to work like I want despite the error message.
> he "mail bucket X to folder Y" list
> on the configuration page didn't
> show up immediately after entering
> the mail server configuration
It isn't supposed to. Thus what you experienced was a case of "behavior by design" ;-)
That's why we have that "Refresh folders now" button.
> but it seems to work like I
> want despite the error message.
When the error message appears then the setting your were trying to apply isn't applied. I suggest you double-check your settings and make sure that your output folders are really the ones you'd like to use. You _can_ map more than one bucket to a single folder _only_ if one of the buckets is the unclassified folder. Everything else is a bug.
Manni
the problem with more then one bucket mapped to a single folder is that the reclassification-on-move doesn't know what bucket you intended to reclassify the message as when you move it to that folder
I use the imap/pop3 configuration of popfile where imap is used for preliminary checking and classifying of all domain mailbox collected in providers part.
The interval for imap checking is 3 minutes. Every 15 minutes my pop3recv agent picks up the rest of Inbox and transfer it to our mail-server for local tossing.
Now pop3recv is used for direct connection to providers mailbox so if the box is busy with popfile imap communications I even don't know whether it is possible to receive smth at the same time. Besides, the situation is possible when the mailbox contains some new mail and pop3recv picks it up before imap module start checking so the spam will be passed to the end user. My question - is there some way to synchronize the sequence or make some flag to be sure that all income mail are checked by imap before it is allowed to be picked up by pop3-receiver.
Another way is to serialize imap with pop3 setting the pop3recv agent to use popfile proxy instead of directly access the provider's box. But here is still some desynchronization possible.
Your ideas are welcome.
the problem is that you have two completely independant programs accessing your mailbox. as such there is no easy way to avoid the race conditions that you are describing.
instead of useing pop3recv to fetch your messages and store them locally can you find something that uses IMAP (fetchmail will do this for example). then instead of leaving the non-spam messages in the inbox, have them moved to another folder and fetch from that folder, that way you will only fetch messages that popfile has processed and moved (and the move should be atomic, no chance of getting a partial message unless you have a defective IMAP server)
Yes, I have already clarified it with provider's support. Communigate Pro allows to pick up mails from any chosen subfolder even for pop3 client. It is enough to add name of the folder before account name like checked#postmaster if "checked" is subfolder with clean mail. Fetchmail could be implemented too, thank you for smart suggestion.
The only unclear point is with reclassifying feedback to imap folders. Please see my message in adjacent topic.