fetchmail-users — User questions and discussion

[fetchmail-users] daemon not cycling as intended

[joea@ j. <jo...@j4...>]

fetchmail, (1.43) in daemon mode, is awakening every 10 minutes, not every two, as intended.

/root/.fetchmailrc contains the statement (among others that appear to be functioning): 

set daemon 120

which, I thought, is 120 seconds, or, two minutes.  According to my watch.

So, it is not reading this correctly, or did I use the wrong syntax or something?

I confess to having used fetchmailconf to configure things.  If that matters.

joe a.

Re: [fetchmail-users] Google Mail officially unsupported by fetchmail

[Rob M. <rob...@gm...>]

On 9/18/07, Matthias Andree <mat...@gm...> wrote:
>
> Well, they're breaking user expectations one way or the other, and I've so
> far resisted the itch of printing and logging warning banners everywhere
> fetchmail comes across gmail...

I might actually suggest that any time fetchmail connects to a
POP/IMAP server that has known problems it should generate a warning.
I'm sure this would cover more than just GMail's unexpected
implementation (from a quick glance at the FAQ).

> And that Hotmail is an inferior service in the eyes of some people, doesn't
> excuse or justify Google's strangeness in any way.

Don't disagree in the slightest, I was just pointing out that GMail at
least doesn't appear to be breaking RFCs, whereas I believe Hotmail
does by silently dropping email after accepting it.

> I see Anne's posting of getting around the Google POP3 interface and still
> have some benefits, but this doesn't bring the whole discussion back into
> the scope of this list I'm afraid...

I agree, I was just attempting to point out that while GMail's POP3
interface may come with a major POLA violation, I don't agree with
Gerard's perspective.  I'm also not certain that the email that
started this divergence actually has GMail's quirks at the heart of it
(it looks probable that the problem is that the end-user has
configured fetchmail to only download 5 messages at a time).

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

Re: [fetchmail-users] Google Mail officially unsupported by fetchmail

[Matthias A. <mat...@gm...>]

Rob MacGregor schrieb:

> If they're breaking the RFCs then by all means report the problems to
> them (and document them in a blog/create threads on digg or
> slashdot/whatever).  However even in the case that spawned this
> thread, I'm not sure they're technically breaking the RFCs, just POLA
> :)

Well, they're breaking user expectations one way or the other, and I've so
far resisted the itch of printing and logging warning banners everywhere
fetchmail comes across gmail...

And that Hotmail is an inferior service in the eyes of some people, doesn't
excuse or justify Google's strangeness in any way.

I see Anne's posting of getting around the Google POP3 interface and still
have some benefits, but this doesn't bring the whole discussion back into
the scope of this list I'm afraid...

Best regards
Matthias

Re: [fetchmail-users] Google Mail officially unsupported by fetchmail (was: fetchmail exis status 1 - Only few emails are getting retrieved.)

[Rob M. <rob...@gm...>]

On 9/18/07, Gerard Seibert <ge...@se...> wrote:
<---SNIP--->
> I believe it is in everybody's interest to simple abandon Google and
> it's email service until they become a more rules compliant service.

You can guess where I sit on this :)

I've found GMail a significantly better service than Hotmail ever was.
 To date I've not lost any messages sent to my GMail account.  I've
documented a number of cases where email sent to, and accepted by,
Hotmail has never arrived.  I've no way of knowing how many other
emails never made it.

Yes, their POP/SMTP interface may not be the best (though I've never
used either so can't speak from experience).  However as a webmail
service I've not had any problems.

If they're breaking the RFCs then by all means report the problems to
them (and document them in a blog/create threads on digg or
slashdot/whatever).  However even in the case that spawned this
thread, I'm not sure they're technically breaking the RFCs, just POLA
:)

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

Re: [fetchmail-users] Google Mail officially unsupported by fetchmail (was: fetchmail exis status 1 - Only few emails are getting retrieved.)

[Anne W. <can...@go...>]

On Tuesday 18 Sep 2007, Gerard Seibert wrote:
> On Tuesday September 18, 2007 at 04:50:36 (AM) Matthias Andree wrote:
> >
> > If this keeps cropping up, we'll have to set up autoresponders and bans
> > for the list.
>
> Allow me to add my 2¢ here. I have always found Google's
> implementation of POP and SMTP to be extremely poorly thought out.
> Quite frankly, the entire concept of Google's email service is subject
> to extreme scrutiny. Google has even started a pay service that is so
> pathetic that if Microsoft had attempted to offer a similar deal to the
> general public, they would be sued for fraud.
>
> I believe it is in everybody's interest to simple abandon Google and
> it's email service until they become a more rules compliant service.

There's more than one way to skin a cat.  Using a gmail account allows google 
to skim out around 50% of spam that comes to me.  Using gmail's forwarding 
facility the remaining messages are then sent to my ISP account.  Used this 
way you get a real benefit, and fetchmail doesn't have to talk to gmail at 
all.

Anne

Re: [fetchmail-users] Google Mail officially unsupported by fetchmail (was: fetchmail exis status 1 - Only few emails are getting retrieved.)

[Gerard S. <ge...@se...>]

On Tuesday September 18, 2007 at 04:50:36 (AM) Matthias Andree wrote:

> This is all a waste of time and has no relation to fetchmail or is
> something fetchmail could do something about at its end, and I'm not
> willing to add workarounds because someone feels incapable to implement
> the rather simplistic POP3 protocol properly.
> 
> I herewith declare Google Mail related issues unsupported in fetchmail.
> 
> Sorry, but I'm fed up with all this Google settings and nonstandard
> behaviour that doesn't work out right and my extremely limited time
> allows me but two choices: get rid of nonsense that ties up even more of
> the time, or quit development altogether. I definitely prefer the
> former.
> 
> I'll accept further Google Mail related patches to the FAQ, and
> fetchmail will continue to do a best effort to fetch messages, but if it
> doesn't work with Google Mail or if you get different results than you
> expect, bother the Google staff instead, but not the fetchmail list
> regulars or maintainers.
> 
> If this keeps cropping up, we'll have to set up autoresponders and bans
> for the list.


Allow me to add my 2¢ here. I have always found Google's
implementation of POP and SMTP to be extremely poorly thought out.
Quite frankly, the entire concept of Google's email service is subject
to extreme scrutiny. Google has even started a pay service that is so
pathetic that if Microsoft had attempted to offer a similar deal to the
general public, they would be sued for fraud.

I believe it is in everybody's interest to simple abandon Google and
it's email service until they become a more rules compliant service.


-- 
Gerard

Re: [fetchmail-users] fetchmail exis status 1 - Only few emails are getting retrieved.

[Rob M. <rob...@gm...>]

On 9/18/07, Dilip M <dil...@gm...> wrote:
>
> l'll send a detailed log later. Its in my home PC.
> Between, found a similar problem, being faced by ppl!

Which strongly suggests it's not a fetchmail problem.

However, as I said try removing the fetch limit in your .fetchmailrc.
If that still doesn't work then provide both your .fetchmailrc and the
entire output of a "fetchmail --nosyslog --nodetach -vvv" (as detailed
in the FAQ under reporting bugs).

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

Re: [fetchmail-users] Google Mail officially unsupported by fetchmail (was: fetchmail exis status 1 - Only few emails are getting retrieved.)

[Matthias A. <mat...@gm...>]

Am Dienstag, den 18.09.2007, 13:40 +0530 schrieb Dilip M:

> l'll send a detailed log later. Its in my home PC.
> Between, found a similar problem, being faced by ppl!
> 
> http://groups.google.com/group/Gmail-POP-and-Forwarding/browse_thread/thread/1b0b48dc63208cc6/422005482555ac47#422005482555ac47
> http://groups.google.com/group/Gmail-POP-and-Forwarding/browse_thread/thread/d9d260d4bd09c1aa/e5bdb51d252e0eff?lnk=gst&q=fetchmail&rnum=16#e5bdb51d252e0eff

This is all a waste of time and has no relation to fetchmail or is
something fetchmail could do something about at its end, and I'm not
willing to add workarounds because someone feels incapable to implement
the rather simplistic POP3 protocol properly.

I herewith declare Google Mail related issues unsupported in fetchmail.

Sorry, but I'm fed up with all this Google settings and nonstandard
behaviour that doesn't work out right and my extremely limited time
allows me but two choices: get rid of nonsense that ties up even more of
the time, or quit development altogether. I definitely prefer the
former.

I'll accept further Google Mail related patches to the FAQ, and
fetchmail will continue to do a best effort to fetch messages, but if it
doesn't work with Google Mail or if you get different results than you
expect, bother the Google staff instead, but not the fetchmail list
regulars or maintainers.

If this keeps cropping up, we'll have to set up autoresponders and bans
for the list.

Sorry again.

Best regards
Matthias Andree
role: fetchmail co-maintainer doing most of the work

Re: [fetchmail-users] fetchmail exis status 1 - Only few emails are getting retrieved.

[Dilip M <dil...@gm...>]

On 9/18/07, Matthias Andree <mat...@gm...> wrote:
...snip...

> Yes. You're not getting the solution faster by providing inaccurate logs
> or whatever. And you're VERY much annoying everyone who is trying to
> help. Don't do that.

O.K..won't be doing this again! Sorry for all

...snip...

> You've snipped the important part, namely how fetchmail learns which
> messages it has seen and which it hasn't. Is it using LAST or UIDL? You
> can force UIDL, and maybe you should if fetchmail isn't using it
> already.

l'll send a detailed log later. Its in my home PC.
Between, found a similar problem, being faced by ppl!

http://groups.google.com/group/Gmail-POP-and-Forwarding/browse_thread/thread/1b0b48dc63208cc6/422005482555ac47#422005482555ac47
http://groups.google.com/group/Gmail-POP-and-Forwarding/browse_thread/thread/d9d260d4bd09c1aa/e5bdb51d252e0eff?lnk=gst&q=fetchmail&rnum=16#e5bdb51d252e0eff

-- 
Dilip

Re: [fetchmail-users] fetchmail exis status 1 - Only few emails are getting retrieved.

[Matthias A. <mat...@gm...>]

Am Dienstag, den 18.09.2007, 00:07 +0530 schrieb Dilip M:
> On 9/17/07, Rob MacGregor <rob...@gm...> wrote:
> 
> ...snip...
> 
> > Posting other people's logs, or made up logs, only complicates matters
> > further.  If you are asking for help you should only ever post the
> > real logs that related to the problem you are seeing.
> 
> I agree! Sorry of that :( But I couldn't wait for to get my fetchmail working!

Yes. You're not getting the solution faster by providing inaccurate logs
or whatever. And you're VERY much annoying everyone who is trying to
help. Don't do that.

> fetchmail: POP3< +OK send PASS
> fetchmail: POP3> PASS *
> .
> .
> ...snip...

You've snipped the important part, namely how fetchmail learns which
messages it has seen and which it hasn't. Is it using LAST or UIDL? You
can force UIDL, and maybe you should if fetchmail isn't using it
already.

-- 
Matthias Andree <mat...@gm...>

Re: [fetchmail-users] fetchmail exis status 1 - Only few emails are getting retrieved.

[Rob M. <rob...@gm...>]

On 9/17/07, Dilip M <dil...@gm...> wrote:
>
> I agree! Sorry of that :( But I couldn't wait for to get my fetchmail working!

Frankly, tough.  An approach like that will quite probably result in
those that can help just ignoring you in future, in the theory that
you may be making up log entries then too.

> Should be. Some problem at gmail end, since they say they will allow
> email in batches for retrieval, if there is many emails!

Nothing fetchmail can do to help you.  As I said, if GMail only
reports 712 emails, all of which fetchmail has downloaded, what do you
expect fetchmail to be able to do?  It doesn't come with a crystal
ball or magic "--control-google" command line option.

> -- Finally the Correct log  --
>
> fetchmail: 6.3.8 querying pop.gmail.com (protocol POP3) at Monday 17
> September 2007 10:28:15 PM IST: poll started
> Trying to connect to 209.85.147.109/995...connected.
<---SNIP--->
> .
> fetchmail: 759 is unseen
> fetchmail: POP3< .
> 759 messages (197 seen) for dil...@gm... at pop.gmail.com
> (4319113 octets).
> skipping message dil...@gm...@gmail-pop.l.google.com:1 not flushed
> skipping message dil...@gm...@gmail-pop.l.google.com:2 not flushed
> .
> .
> fetchmail: fetchlimit 5 reached; 754 messages left on server
> gmail-pop.l.google.com account dil...@gm...
> fetchmail: POP3> QUIT
> fetchmail: POP3< +OK Farewell.
> fetchmail: 6.3.8 querying pop.gmail.com (protocol POP3) at Monday 17
> September 2007 10:28:29 PM IST: poll completed
> fetchmail: swapping UID lists
> fetchmail: Query status=13 (MAXFETCH)
> fetchmail: Writing fetchids file.
> fetchmail: normal termination, status 13
> fetchmail: Writing fetchids file.

Care to restate your problem?  You've configured fetchmail to download
the emails in batches of 5 per run and you have 754 emails remaining.
It will take 151 runs to completely download the existing emails that
GMail reported at that point.  Why not remove the fetchlimit option?

It would help to see your .fetchmailrc file if you want further help.

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

Re: [fetchmail-users] fetchmail exis status 1 - Only few emails are getting retrieved.

[Dilip M <dil...@gm...>]

On 9/17/07, Rob MacGregor <rob...@gm...> wrote:

...snip...

> Posting other people's logs, or made up logs, only complicates matters
> further.  If you are asking for help you should only ever post the
> real logs that related to the problem you are seeing.

I agree! Sorry of that :( But I couldn't wait for to get my fetchmail working!

...snip...

> From memory somebody reported problems with fetching from GMail - have
> you searched the list archive?

Yes, searched before posting here. Couldn't find the problem, which I'm facing!

> Otherwise, this isn't really a problem fetchmail can solve.  If GMail
> is only reporting 712 emails and fetchmail has already downloaded all
> of them I don't know what you expect fetchmail to do

Should be. Some problem at gmail end, since they say they will allow
email in batches for retrieval, if there is many emails!
http://mail.google.com/support/bin/answer.py?answer=13291&useful=1&show_useful=1

-- Finally the Correct log  --

fetchmail: 6.3.8 querying pop.gmail.com (protocol POP3) at Monday 17
September 2007 10:28:15 PM IST: poll started
Trying to connect to 209.85.147.109/995...connected.
fetchmail: Issuer Organization: Equifax
fetchmail: Unknown Issuer CommonName
fetchmail: Server CommonName: pop.gmail.com
fetchmail: pop.gmail.com key fingerprint:
59:51:61:89:CD:DD:B2:35:94:BB:44:97:A0:39:D5:B4
fetchmail: POP3< +OK Gpop ready for requests from 59.92.131.148 n37pf5312383wag
fetchmail: POP3> USER dil...@gm...
fetchmail: POP3< +OK send PASS
fetchmail: POP3> PASS *
.
.
...snip...
.
.
fetchmail: 759 is unseen
fetchmail: POP3< .
759 messages (197 seen) for dil...@gm... at pop.gmail.com
(4319113 octets).
skipping message dil...@gm...@gmail-pop.l.google.com:1 not flushed
skipping message dil...@gm...@gmail-pop.l.google.com:2 not flushed
.
.
fetchmail: fetchlimit 5 reached; 754 messages left on server
gmail-pop.l.google.com account dil...@gm...
fetchmail: POP3> QUIT
fetchmail: POP3< +OK Farewell.
fetchmail: 6.3.8 querying pop.gmail.com (protocol POP3) at Monday 17
September 2007 10:28:29 PM IST: poll completed
fetchmail: swapping UID lists
fetchmail: Query status=13 (MAXFETCH)
fetchmail: Writing fetchids file.
fetchmail: normal termination, status 13
fetchmail: Writing fetchids file.

-- End of log --


-- 
Dilip

Re: [fetchmail-users] fetchmail exis status 1 - Only few emails are getting retrieved.

[Rob M. <rob...@gm...>]

On 9/17/07, Dilip M <dil...@gm...> wrote:
>
> No its not a correct log! Sorry!. Actually, I use fetchmail at home.
> So used a similar error, which was over internet.

Posting other people's logs, or made up logs, only complicates matters
further.  If you are asking for help you should only ever post the
real logs that related to the problem you are seeing.

> It should be exactly
> like,
>
>
> -- Log started. --
>
> ...snip...
>
> 712 messages (712 seen) for ........at gmail.com at pop.gmail.com
>
> ...snip....
>
>
> fetchmail: POP3> QUIT
> fetchmail: POP3< +OK Farewell.
> fetchmail: 6.3.8 querying pop.gmail.com (protocol POP3) at Sun Sep 16 23
> 16:22:45 2007: poll completed
> fetchmail: Query status=1 (NOMAIL)
> fetchmail: Writing fetchids file.
> fetchmail: normal termination, status 1
> fetchmail: swapping UID lists
> fetchmail: Query status=1 (NOMAIL)
> .
> .
> -
>
> - End of log
> I feel, I need to repost this, before someone gets routed to wrong address..

From memory somebody reported problems with fetching from GMail - have
you searched the list archive?

Otherwise, this isn't really a problem fetchmail can solve.  If GMail
is only reporting 712 emails and fetchmail has already downloaded all
of them I don't know what you expect fetchmail to do.

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

Re: [fetchmail-users] fetchmail exis status 1 - Only few emails are getting retrieved.

[Dilip M <dil...@gm...>]

On 9/17/07, N.J. Mann <nj...@nj...> wrote:
...snip...

> This says you are using fetchmail 6.2.5 and not 6.3.8 as you claim.  It
> also says that the poll was completed at 16:22:45 on Fri Dec 23 2005!
> Is this the correct log file?

No its not a correct log! Sorry!. Actually, I use fetchmail at home.
So used a similar error, which was over internet. It should be exactly
like,


-- Log started. --

...snip...

712 messages (712 seen) for ........at gmail.com at pop.gmail.com

...snip....


fetchmail: POP3> QUIT
fetchmail: POP3< +OK Farewell.
fetchmail: 6.3.8 querying pop.gmail.com (protocol POP3) at Sun Sep 16 23
16:22:45 2007: poll completed
fetchmail: Query status=1 (NOMAIL)
fetchmail: Writing fetchids file.
fetchmail: normal termination, status 1
fetchmail: swapping UID lists
fetchmail: Query status=1 (NOMAIL)
.
.
-

- End of log
I feel, I need to repost this, before someone gets routed to wrong address..

-- 
Dilip

Re: [fetchmail-users] fetchmail exis status 1 - Only few emails are getting retrieved.

[N.J. M. <nj...@nj...>]

In message <6e7...@ma...>,
Dilip M wrote:
> 
> fetchmail version: 6.3.8. A default that comes with ubuntu.
[...]

> 4. What I noticed, is the logfile says...
> 
> ...snip...
> 
> 712 messages (712 seen) for ........at gmail.com at pop.gmail.com
> 
> ...snip....
> 
> 
> fetchmail: POP3> QUIT
> fetchmail: POP3< +OK Farewell.
> fetchmail: 6.2.5 querying pop.gmail.com (protocol POP3) at Fri Dec 23
> 16:22:45 2005: poll completed
> fetchmail: normal termination, status 1

This says you are using fetchmail 6.2.5 and not 6.3.8 as you claim.  It
also says that the poll was completed at 16:22:45 on Fri Dec 23 2005!
Is this the correct log file?


Cheers,
       Nick.
-- 

[fetchmail-users] fetchmail exis status 1 - Only few emails are getting retrieved.

[Dilip M <dil...@gm...>]

Hi,

===
fetchmail version: 6.3.8. A default that comes with ubuntu.
===

Thank you for Andrew to make this setup easy for beginners :)
http://people.aapt.net.au/~adjlstrong/mutt.html#fetchmail


** I'm getting a EXIT STATUS 1, using fetchmail to POP gmails! **

1. First logged into gmail webmail and activated "Enable POP for all
mail (even mail that's already been downloaded)". + "Keep a copy..."

There are ~ 3000 emails in my gmail inbox!

2. My "~/.fetcmailrc", is

====
poll pop.gmail.com                   # Tell fetchmail about server
with proto POP3                      # Use the POP-protocol
user 'use...@gm... '               # Your Gmail Username
there with password '****' # Your Gmail Password
is 'dilipm' here                   # Local Username
mda "/usr/bin/procmail -d %T"        # Tell fetchmail which MDA to use
options                              # Options duh
keep                                 # Keep the mail on server = safe
ssl
sslcertck
sslcertpath /etc/ssl/certs
====

3. Did 'fetchmail -vv' for the first time, and emails are getting
fetched. Since gmail makes them available in batches. I executed
fetchmail -vv, several times..

[http://mail.google.com/support/bin/answer.py?answer=13291&useful=1&show_useful=1]

4. What I noticed, is the logfile says...

...snip...

712 messages (712 seen) for ........at gmail.com at pop.gmail.com

...snip....


fetchmail: POP3> QUIT
fetchmail: POP3< +OK Farewell.
fetchmail: 6.2.5 querying pop.gmail.com (protocol POP3) at Fri Dec 23
16:22:45 2005: poll completed
fetchmail: normal termination, status 1

Exit code 1 means, There was no mail awaiting retrieval. (There may
have been old mail still on the server but not selected for
retrieval.)

But there are still many emails!  Don't know, why they are not selected for
retrieval!

I also did, rm ~/fetchids and moved the mailbox + again set the "Enable
POP for all mail (even mail that's already been downloaded)"..and
repeated the 4 steps again...I get the *same* emails...but not
remaining.

Has anyone faced a same problem?

--
Dilip


-- 
Dilip

[fetchmail-users] fetchmail exis status 1 - Only few emails are getting retrieved.

[Dilip M <dil...@gm...>]

Hi,

===
fetchmail version: 6.3.8. A default that comes with ubuntu.
===

Thank you for Andrew to make this setup easy for beginners :)
http://people.aapt.net.au/~adjlstrong/mutt.html#fetchmail


** I'm getting a EXIT STATUS 1, using fetchmail to POP gmails! **

1. First logged into gmail webmail and activated "Enable POP for all
mail (even mail that's already been downloaded)". + "Keep a copy..."

There are ~ 3000 emails in my gmail inbox!

2. My "~/.fetcmailrc", is

====
poll pop.gmail.com                   # Tell fetchmail about server
with proto POP3                      # Use the POP-protocol
user 'use...@gm... '               # Your Gmail Username
there with password '****' # Your Gmail Password
is 'dilipm' here                   # Local Username
mda "/usr/bin/procmail -d %T"        # Tell fetchmail which MDA to use
options                              # Options duh
keep                                 # Keep the mail on server = safe
ssl
sslcertck
sslcertpath /etc/ssl/certs
====

3. Did 'fetchmail -vv' for the first time, and emails are getting
fetched. Since gmail makes them available in batches. I executed
fetchmail -vv, several times..

[http://mail.google.com/support/bin/answer.py?answer=13291&useful=1&show_useful=1]

4. What I noticed, is the logfile says...

...snip...

712 messages (712 seen) for ........at gmail.com at pop.gmail.com

...snip....


fetchmail: POP3> QUIT
fetchmail: POP3< +OK Farewell.
fetchmail: 6.2.5 querying pop.gmail.com (protocol POP3) at Fri Dec 23
16:22:45 2005: poll completed
fetchmail: normal termination, status 1

Exit code 1 means, There was no mail awaiting retrieval. (There may
have been old mail still on the server but not selected for
retrieval.)

But there are still many emails!  Don't know, why they are not selected for
retrieval!

I also did, rm ~/fetchids and moved the mailbox + again set the "Enable
POP for all mail (even mail that's already been downloaded)"..and
repeated the 4 steps again...I get the *same* emails...but not
remaining.

Has anyone faced a same problem?

-- 
Dilip

Re: [fetchmail-users] fetchmail continuously fetching already fetched imap email

[Matthew L. H. <mat...@gm...>]

* Matthias Andree <mat...@gm...> [2007-09-10 22:51:28 +0200]:

>Lee Hinman schrieb am 2007-09-10:
>
>> I see that the -a option is why it is downloading all the old
>> messages, however, if I get an email on a different machine (a Windows
>> machine) and I read it, fetchmail doesn't download it for some reason.
>
>That reason is unfortunately a design flaw, in that the former
>maintainer believed it were sufficient to track "I've seen this message"
>on the server side. This is based on the assumption that fetchmail were
>the only software accessing your mailbox, evidently untrue in your case,
>and in many more cases, too. You need client-side tracking, which
>fetchmail cannot currently do for IMAP. It's on the TODO list for the
>next major release though, but resources are very limited.
>
>> It only downloads the "unseen" messages. What I would like is to
>> download any message that *this* computer hasn't seen, even the ones
>> I've already read on my Windows machines.
>
>This is not yet implemented in fetchmail unfortunately. The patches that
>are available are also not sufficient in that they are agnostic of the
>"UIDVALIDITY".
>
>If you're just fetching messages from the INBOX, you may have more luck
>with POP3 + UIDL (the latter is important and not the default
>unfortunately).
>
>> Is there a way to accomplish this?
>
>Not in fetchmail. Sorry for that.
>
>HTH
>
>Best regards,
>
>-- 
>Matthias Andree
>_______________________________________________
>fetchmail-users mailing list
>fet...@li...
>https://lists.berlios.de/mailman/listinfo/fetchmail-users

Thank you both for the help, luckily, after some research, I found out
that the exchange server also offers a POP3 method to access the mail,
so I am able to access it through that.

Thanks!
- Lee

Re: [fetchmail-users] fetchmail continuously fetching already fetched imap email

[Matthias A. <mat...@gm...>]

Lee Hinman schrieb am 2007-09-10:

> I see that the -a option is why it is downloading all the old
> messages, however, if I get an email on a different machine (a Windows
> machine) and I read it, fetchmail doesn't download it for some reason.

That reason is unfortunately a design flaw, in that the former
maintainer believed it were sufficient to track "I've seen this message"
on the server side. This is based on the assumption that fetchmail were
the only software accessing your mailbox, evidently untrue in your case,
and in many more cases, too. You need client-side tracking, which
fetchmail cannot currently do for IMAP. It's on the TODO list for the
next major release though, but resources are very limited.

> It only downloads the "unseen" messages. What I would like is to
> download any message that *this* computer hasn't seen, even the ones
> I've already read on my Windows machines.

This is not yet implemented in fetchmail unfortunately. The patches that
are available are also not sufficient in that they are agnostic of the
"UIDVALIDITY".

If you're just fetching messages from the INBOX, you may have more luck
with POP3 + UIDL (the latter is important and not the default
unfortunately).

> Is there a way to accomplish this?

Not in fetchmail. Sorry for that.

HTH

Best regards,

-- 
Matthias Andree

Re: [fetchmail-users] fetchmail continuously fetching already fetched imap email

[Rob M. <rob...@gm...>]

On 9/10/07, Lee Hinman <mat...@gm...> wrote:
>
> I see that the -a option is why it is downloading all the old
> messages, however, if I get an email on a different machine (a Windows
> machine) and I read it, fetchmail doesn't download it for some reason.

Ah, now you're getting into territory fetchmail is not designed to handle.

> It only downloads the "unseen" messages. What I would like is to
> download any message that *this* computer hasn't seen, even the ones
> I've already read on my Windows machines.
>
> Is there a way to accomplish this?

No, because right now there is no client side tracking of IMAP emails
(only POP).  If your provider supports POP (with UIDL) then you can
use that as your solution, but there isn't any way to achieve this
with IMAP.

Alternatively, use the fact that you're downloading the emails with
fetchmail and run a local IMAP server, pointing your Windows client at
it.

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

Re: [fetchmail-users] fetchmail continuously fetching already fetched imap email

[Lee H. <mat...@gm...>]

On 9/10/07, Rob MacGregor <rob...@gm...> wrote:
> Keep it on the list please.
>
> On 9/10/07, Lee Hinman <mat...@gm...> wrote:
> >
> > It looks like the Message-IDs are the same for both emails
>
> I'd tend to agree.
>
> > Every time
> > I run "fetchmail -a" again, it downloads all of the messages again
> > (over 300 unfortunately).
>
> You may want to read the man page and see what the "-a" option means:
>
> | Retrieve both old (seen) and new messages
> | from the mailserver
>
> Which may just explain the "problem" you're having ;)
>
> --
>                  Please keep list traffic on the list.
>
> Rob MacGregor
>       Whoever fights monsters should see to it that in the process he
>         doesn't become a monster.                  Friedrich Nietzsche
> _______________________________________________
> fetchmail-users mailing list
> fet...@li...
> https://lists.berlios.de/mailman/listinfo/fetchmail-users
>

Sorry, accidently hit reply instead of replying to the list.

I see that the -a option is why it is downloading all the old
messages, however, if I get an email on a different machine (a Windows
machine) and I read it, fetchmail doesn't download it for some reason.
It only downloads the "unseen" messages. What I would like is to
download any message that *this* computer hasn't seen, even the ones
I've already read on my Windows machines.

Is there a way to accomplish this?

Thank you very much for the help, very appreciated!

- Lee

Re: [fetchmail-users] fetchmail continuously fetching already fetched imap email

[Rob M. <rob...@gm...>]

Keep it on the list please.

On 9/10/07, Lee Hinman <mat...@gm...> wrote:
>
> It looks like the Message-IDs are the same for both emails

I'd tend to agree.

> Every time
> I run "fetchmail -a" again, it downloads all of the messages again
> (over 300 unfortunately).

You may want to read the man page and see what the "-a" option means:

| Retrieve both old (seen) and new messages
| from the mailserver

Which may just explain the "problem" you're having ;)

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

Re: [fetchmail-users] fetchmail continuously fetching already fetched imap email

[Rob M. <rob...@gm...>]

On 9/10/07, Lee Hinman <mat...@gm...> wrote:
>
> And the output of fetchmail --nosyslog --nodetach -vvv:
> fetchmail: 6.3.8 querying corpusmx10c.corp.emc.com (protocol IMAP) at
> Mon, 10 Sep 2007 13:49:50 -0600 (MDT): poll started
> Trying to connect to 128.221.14.108/143...connected.
> fetchmail: IMAP< * OK Microsoft Exchange Server 2003 IMAP4rev1 server
> version 6.5.7638.1 (CORPUSMX10C.corp.emc.com) ready.
> fetchmail: IMAP> A0001 CAPABILITY
> fetchmail: IMAP< * CAPABILITY IMAP4 IMAP4rev1 IDLE LOGIN-REFERRALS
> MAILBOX-REFERRALS NAMESPACE LITERAL+ UIDPLUS CHILDREN AUTH=NTLM
> fetchmail: IMAP< A0001 OK CAPABILITY completed.
> fetchmail: Protocol identified as IMAP4 rev 1
> fetchmail: corpusmx10c.corp.emc.com: opportunistic upgrade to TLS
> failed, trying to continue
> fetchmail: IMAP> A0002 NOOP
> fetchmail: IMAP< A0002 OK NOOP completed.
> fetchmail: IMAP> A0003 LOGIN "*********" *
> fetchmail: IMAP< A0003 OK LOGIN completed.
> fetchmail: selecting or re-polling default folder
> fetchmail: IMAP> A0004 SELECT "INBOX"
> fetchmail: IMAP< * 299 EXISTS
> fetchmail: IMAP< * 0 RECENT
> fetchmail: IMAP< * FLAGS (\Seen \Answered \Flagged \Deleted \Draft $MDNSent)
> fetchmail: IMAP< * OK [PERMANENTFLAGS (\Seen \Answered \Flagged
> \Deleted \Draft $MDNSent)] Permanent flags
> fetchmail: IMAP< * OK [UIDVALIDITY 3890] UIDVALIDITY value
> fetchmail: IMAP< A0004 OK [READ-WRITE] SELECT completed.
> fetchmail: 299 messages waiting after first poll
> fetchmail: IMAP> A0005 SEARCH UNSEEN NOT DELETED
> fetchmail: IMAP< * SEARCH
> fetchmail: IMAP< A0005 OK SEARCH completed.
> 299 messages (299 seen) for corp\hinmam at corpusmx10c.corp.emc.com.
> skipping message corp\hi...@co...:1 not flushed
> skipping message corp\hi...@co...:2 not flushed
> ... skipped because there are lots of messages ...
> skipping message corp\hi...@co...:298 not flushed
> skipping message corp\hi...@co...:299 not flushed
> fetchmail: IMAP> A0006 LOGOUT
> fetchmail: IMAP< * BYE Microsoft Exchange Server 2003 IMAP4rev1 server
> version 6.5.7638.1 signing off.
> fetchmail: IMAP< A0006 OK LOGOUT completed.
> fetchmail: 6.3.8 querying corpusmx10c.corp.emc.com (protocol IMAP) at
> Mon, 10 Sep 2007 13:49:52 -0600 (MDT): poll completed
> fetchmail: not swapping UID lists, no UIDs seen this query
> fetchmail: Query status=1 (NOMAIL)
> fetchmail: Deleting fetchids file.
> fetchmail: normal termination, status 1
> fetchmail: Deleting fetchids file.

I don't see the behaviour you describe in your initial email.  Can you
confirm that the problem (of the same message being downloaded at
every run) is ongoing.

Can you also double check that it really is the same message (that is,
it has the same Message-ID and all the other headers are also
identical).

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

Re: [fetchmail-users] fetchmail continuously fetching already fetched imap email

[Lee H. <mat...@gm...>]

On 9/10/07, Rob MacGregor <rob...@gm...> wrote:
> On 9/10/07, Lee Hinman <mat...@gm...> wrote:
> > Hi fetchmail-users,
> > I'm having some trouble getting fetchmail not to keep fetching the
> > same IMAP messages over and over and over again. Here is what I have
> > in my .fetchmailrc:
> >
> > poll corpusmx10c.corp.emc.com
> > with proto IMAP
> > user '**********'
> > there with password '**********'
> > is '*********' here
> > mda "/usr/bin/procmail -d %T"
> > options keep
> >
> > Is there an option that I am setting incorrectly that makes it ignore
> > the messages that have already been downloaded? Is "keep" the right
> > option? (I don't want it to delete the messages, because I'd like to
> > read the messages from a different computer also).
>
> Version of fetchmail?
>
> Transcript as specified in the FAQ
> (http://www.fetchmail.info/fetchmail-FAQ.html#G3 - "fetchmail
> --nosyslog --nodetach -vvv", along with your usual command line
> options).
>
> Also very useful would be the output from adding "--configdump" to
> your usual command line options.
>
> --
>                  Please keep list traffic on the list.
>
> Rob MacGregor
>       Whoever fights monsters should see to it that in the process he
>         doesn't become a monster.                  Friedrich Nietzsche
> _______________________________________________
> fetchmail-users mailing list
> fet...@li...
> https://lists.berlios.de/mailman/listinfo/fetchmail-users
>

Here in my configdump:

[hinmanm@Euclid] $ fetchmail --nosyslog --nodetach -vvv --configdump
                                                         ~
TRUE=1; FALSE=0

os_type = 'generic'
feature_options = ('pop3','imap','gssapi','kerberos','etrn','odmr','ssl',)
# Start of configuration initializer
fetchmailrc = {
    'poll_interval':0,
    "logfile":None,
    "idfile":"/Users/hinmanm/.fetchids",
    "postmaster":"hinmanm",
    'bouncemail':TRUE,
    'spambounce':FALSE,
    "properties":None,
    'invisible':FALSE,
    'showdots':TRUE,
    'syslog':FALSE,
    # List of server entries begins here
    'servers': [
     # Entry for site `corpusmx10c.corp.emc.com' begins:
     {
         "pollname":"corpusmx10c.corp.emc.com",
         'active':TRUE,
         "via":None,
         "protocol":"IMAP",
         "service":None,
         'timeout':300,
         'interval':0,
         "envelope":"Received",
         'envskip':0,
         "qvirtual":None,
         "auth":"any",
         'dns':TRUE,
         'uidl':FALSE,
         "aka":[],
         "localdomains":[],
         "plugin":None,
         "plugout":None,
         "principal":None,
         'tracepolls':FALSE,
         'users': [
        {
            "remote":"*********",
            "password":"*********",
            'localnames':["hinmanm"],
            'fetchall':FALSE,
            'keep':TRUE,
            'flush':FALSE,
            'limitflush':FALSE,
            'rewrite':TRUE,
            'stripcr':TRUE,
            'forcecr':FALSE,
            'pass8bits':FALSE,
            'dropstatus':FALSE,
            'dropdelivered':FALSE,
            'mimedecode':FALSE,
            'idle':FALSE,
            "mda":"/usr/bin/procmail -d %T",
            "bsmtp":None,
            'lmtp':FALSE,
            "preconnect":None,
            "postconnect":None,
            'limit':0,
            'warnings':3600,
            'fetchlimit':0,
            'fetchsizelimit':100,
            'fastuidl':4,
            'batchlimit':0,
            'ssl':FALSE,
            "sslkey":None,
            "sslcert":None,
            "sslproto":None,
            'sslcertck':FALSE,
            "sslcertpath":None,
            "sslfingerprint":None,
            'expunge':0,
            "properties":None,
            "smtphunt":["localhost"],
            "fetchdomains":[],
            "smtpaddress":None,
            "smtpname":None,
            'antispam':'',
            "mailboxes":[],
        }
        ,           ]
     }
    ]
}
# End of initializer


And the output of fetchmail --nosyslog --nodetach -vvv:
fetchmail: 6.3.8 querying corpusmx10c.corp.emc.com (protocol IMAP) at
Mon, 10 Sep 2007 13:49:50 -0600 (MDT): poll started
Trying to connect to 128.221.14.108/143...connected.
fetchmail: IMAP< * OK Microsoft Exchange Server 2003 IMAP4rev1 server
version 6.5.7638.1 (CORPUSMX10C.corp.emc.com) ready.
fetchmail: IMAP> A0001 CAPABILITY
fetchmail: IMAP< * CAPABILITY IMAP4 IMAP4rev1 IDLE LOGIN-REFERRALS
MAILBOX-REFERRALS NAMESPACE LITERAL+ UIDPLUS CHILDREN AUTH=NTLM
fetchmail: IMAP< A0001 OK CAPABILITY completed.
fetchmail: Protocol identified as IMAP4 rev 1
fetchmail: corpusmx10c.corp.emc.com: opportunistic upgrade to TLS
failed, trying to continue
fetchmail: IMAP> A0002 NOOP
fetchmail: IMAP< A0002 OK NOOP completed.
fetchmail: IMAP> A0003 LOGIN "*********" *
fetchmail: IMAP< A0003 OK LOGIN completed.
fetchmail: selecting or re-polling default folder
fetchmail: IMAP> A0004 SELECT "INBOX"
fetchmail: IMAP< * 299 EXISTS
fetchmail: IMAP< * 0 RECENT
fetchmail: IMAP< * FLAGS (\Seen \Answered \Flagged \Deleted \Draft $MDNSent)
fetchmail: IMAP< * OK [PERMANENTFLAGS (\Seen \Answered \Flagged
\Deleted \Draft $MDNSent)] Permanent flags
fetchmail: IMAP< * OK [UIDVALIDITY 3890] UIDVALIDITY value
fetchmail: IMAP< A0004 OK [READ-WRITE] SELECT completed.
fetchmail: 299 messages waiting after first poll
fetchmail: IMAP> A0005 SEARCH UNSEEN NOT DELETED
fetchmail: IMAP< * SEARCH
fetchmail: IMAP< A0005 OK SEARCH completed.
299 messages (299 seen) for corp\hinmam at corpusmx10c.corp.emc.com.
skipping message corp\hi...@co...:1 not flushed
skipping message corp\hi...@co...:2 not flushed
... skipped because there are lots of messages ...
skipping message corp\hi...@co...:298 not flushed
skipping message corp\hi...@co...:299 not flushed
fetchmail: IMAP> A0006 LOGOUT
fetchmail: IMAP< * BYE Microsoft Exchange Server 2003 IMAP4rev1 server
version 6.5.7638.1 signing off.
fetchmail: IMAP< A0006 OK LOGOUT completed.
fetchmail: 6.3.8 querying corpusmx10c.corp.emc.com (protocol IMAP) at
Mon, 10 Sep 2007 13:49:52 -0600 (MDT): poll completed
fetchmail: not swapping UID lists, no UIDs seen this query
fetchmail: Query status=1 (NOMAIL)
fetchmail: Deleting fetchids file.
fetchmail: normal termination, status 1
fetchmail: Deleting fetchids file.


And fetchmail is normally called like so:
fetchmail -a $EXTRAARG >/dev/null 2>&1
where $EXTRAARG can be "-v" or not

And the version of fetchmail from fetchmail -V:
This is fetchmail release 6.3.8+GSS+SSL+KRB4+KRB5.

Copyright (C) 2002, 2003 Eric S. Raymond
Copyright (C) 2004 Matthias Andree, Eric S. Raymond, Robert M. Funk,
Graham Wilson
Copyright (C) 2005-2006 Sunil Shetye
Copyright (C) 2005-2007 Matthias Andree
Fetchmail comes with ABSOLUTELY NO WARRANTY. This is free software, and you
are welcome to redistribute it under certain conditions. For details,
please see the file COPYING in the source or documentation directory.

Fallback MDA: (none)
Darwin Euclid.local 8.10.1 Darwin Kernel Version 8.10.1: Wed May 23
16:33:00 PDT 2007; root:xnu-792.22.5~1/RELEASE_I386 i386 i386
Taking options from command line and /Users/hinmanm/.fetchmailrc
Idfile is /Users/hinmanm/.fetchids
Fetchmail will show progress dots even in logfiles.
Fetchmail will forward misaddressed multidrop messages to hinmanm.
Options for retrieving from *********@corpusmx10c.corp.emc.com:
  True name of server is corpusmx10c.corp.emc.com.
  Protocol is IMAP.
  All available authentication methods will be tried.
  Server nonresponse timeout is 300 seconds (default).
  Default mailbox selected.
  Only new messages will be retrieved (--all off).
  Fetched messages will be kept on the server (--keep on).
  Old messages will not be flushed before message retrieval (--flush off).
  Oversized messages will not be flushed before message retrieval
(--limitflush off).
  Rewrite of server-local addresses is enabled (--norewrite off).
  Carriage-return stripping is enabled (stripcr on).
  Carriage-return forcing is disabled (forcecr off).
  Interpretation of Content-Transfer-Encoding is enabled (pass8bits off).
  MIME decoding is disabled (mimedecode off).
  Idle after poll is disabled (idle off).
  Nonempty Status lines will be kept (dropstatus off)
  Delivered-To lines will be kept (dropdelivered off)
  Fetch message size limit is 100 (--fetchsizelimit 100).
  Do binary search of UIDs during 3 out of 4 polls (--fastuidl 4).
  Messages will be delivered with "/usr/bin/procmail -d %T".
  Single-drop mode: 1 local name recognized.
  No UIDs saved from this host.

I believe this is the information, is there anything else that would
be helpful to you?

Re: [fetchmail-users] fetchmail continuously fetching already fetched imap email

[Rob M. <rob...@gm...>]

On 9/10/07, Lee Hinman <mat...@gm...> wrote:
> Hi fetchmail-users,
> I'm having some trouble getting fetchmail not to keep fetching the
> same IMAP messages over and over and over again. Here is what I have
> in my .fetchmailrc:
>
> poll corpusmx10c.corp.emc.com
> with proto IMAP
> user '**********'
> there with password '**********'
> is '*********' here
> mda "/usr/bin/procmail -d %T"
> options keep
>
> Is there an option that I am setting incorrectly that makes it ignore
> the messages that have already been downloaded? Is "keep" the right
> option? (I don't want it to delete the messages, because I'd like to
> read the messages from a different computer also).

Version of fetchmail?

Transcript as specified in the FAQ
(http://www.fetchmail.info/fetchmail-FAQ.html#G3 - "fetchmail
--nosyslog --nodetach -vvv", along with your usual command line
options).

Also very useful would be the output from adding "--configdump" to
your usual command line options.

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche