Thread: [Fetchmail-users] Retrieving read messages from IMAP server

Client daemon to move mail from POP and IMAP to your local computer

Brought to you by: m-a, question42, robfunk

fetchmail-users

[Fetchmail-users] Retrieving read messages from IMAP server

From: Jerry <je...@se...> - 2014-07-19 17:46:40

I am probably doing something really stupid here, but I am not sure what.

I have fetchmail set up to retrieve mail from an IMAP account I have. Now,
this IMAP account is also accessed from my laptop computer when I am
traveling. If I retrieve a message directly from the IMAP account onto my
laptop, fetchmail will no longer download it onto my work station computer.
However, if fetchmail downloads the email first, it is still available for
download onto my laptop. I hope this all makes sense.

This is the config from my fetchmailrc file. Obviously, I have modified the
actual user name and password.

# Configuration created Tue Jul  1 15:56:47 2014 by fetchmailconf 1.57
set idfile "/var/tmp/.fetchids"
set logfile "/var/log/fetchmail"
set postmaster "postmaster"
set bouncemail
set no spambounce
set softbounce
set properties ""

poll muon.mfg-consulting-llc.com proto IMAP timeout 30 and options bad-header accept
user 'US...@IS...' there with password 'SECRET' is 'US...@IS...' here options keep ssl dropdelivered smtpname 'Som...@XX...' sslfingerprint '52:83:BD:F4:EB:72:70:1A:AA:3A:F9:13:65:9A:59:2E'

-- 
Jerry

Re: [Fetchmail-users] Retrieving read messages from IMAP server

From: Rob M. <rob...@gm...> - 2014-07-20 14:57:12

On Sat, Jul 19, 2014 at 6:46 PM, Jerry <je...@se...> wrote:
> I am probably doing something really stupid here, but I am not sure what.

What version (number) of fetchmail and what operating system are you using?

> I have fetchmail set up to retrieve mail from an IMAP account I have. Now,
> this IMAP account is also accessed from my laptop computer when I am
> traveling. If I retrieve a message directly from the IMAP account onto my
> laptop, fetchmail will no longer download it onto my work station computer.
> However, if fetchmail downloads the email first, it is still available for
> download onto my laptop. I hope this all makes sense.

Have you confirmed that the (unspecified) program on your laptop is
really using IMAP and leaving the messages behind? It sounds more
likely that it's either using POP3 or it's deleting them.

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

Re: [Fetchmail-users] Retrieving read messages from IMAP server

From: Jerry <je...@se...> - 2014-07-20 15:34:51

On Sun, 20 Jul 2014 15:57:02 +0100, Rob MacGregor stated:

> Have you confirmed that the (unspecified) program on your laptop is
> really using IMAP and leaving the messages behind? It sounds more
> likely that it's either using POP3 or it's deleting them.

Yes, I have. Using MS Outlook 15.0.4631.1002 on my laptop. Outlook is
configured to use IMAP for the account in question. I can go to the webmail
site and confirm that the message is still there; however, it is marked as
read. Fetchmail will not not download it. If I first use fetchmail to
retrieve the email, it is also left on the site and Outlook will retrieve it.
I figure I must have something configured incorrectly.

-- 
Jerry

Re: [Fetchmail-users] Retrieving read messages from IMAP server

From: Rob M. <rob...@gm...> - 2014-07-20 17:17:52

On Sun, Jul 20, 2014 at 4:34 PM, Jerry <je...@se...> wrote:
> On Sun, 20 Jul 2014 15:57:02 +0100, Rob MacGregor stated:
>
> Yes, I have. Using MS Outlook 15.0.4631.1002 on my laptop. Outlook is
> configured to use IMAP for the account in question. I can go to the webmail
> site and confirm that the message is still there; however, it is marked as
> read. Fetchmail will not not download it. If I first use fetchmail to
> retrieve the email, it is also left on the site and Outlook will retrieve it.
> I figure I must have something configured incorrectly.

Please see section G3 of the FAQ:
http://www.fetchmail.info/fetchmail-FAQ.html#G3

It lists the information we need to help you. A transcript that
includes a failure to retrieve a message that's on the server would
help too.

-- 
                 Please keep list traffic on the list.

Rob MacGregor
      Whoever fights monsters should see to it that in the process he
        doesn't become a monster.                  Friedrich Nietzsche

Re: [Fetchmail-users] Retrieving read messages from IMAP server

From: Jerry <je...@se...> - 2014-07-20 18:57:43

On Sun, 20 Jul 2014 18:17:42 +0100, Rob MacGregor stated:

> On Sun, Jul 20, 2014 at 4:34 PM, Jerry <je...@se...> wrote:
> > On Sun, 20 Jul 2014 15:57:02 +0100, Rob MacGregor stated:
> >
> > Yes, I have. Using MS Outlook 15.0.4631.1002 on my laptop. Outlook is
> > configured to use IMAP for the account in question. I can go to the
> > webmail site and confirm that the message is still there; however, it is
> > marked as read. Fetchmail will not not download it. If I first use
> > fetchmail to retrieve the email, it is also left on the site and Outlook
> > will retrieve it. I figure I must have something configured incorrectly.
> 
> Please see section G3 of the FAQ:
> http://www.fetchmail.info/fetchmail-FAQ.html#G3
> 
> It lists the information we need to help you. A transcript that
> includes a failure to retrieve a message that's on the server would
> help too.

env LC_ALL=C fetchmail --nodetach -vvv --nosyslog

Old UID list from muon.mfg-consulting-llc.com: <empty>
Scratch list of UIDs: <empty>
fetchmail: 6.3.26 querying muon.mfg-consulting-llc.com (protocol IMAP) at Sun Jul 20 14:44:57 2014: poll started
Trying to connect to 69.16.208.160/143...connected.
fetchmail: IMAP< * OK [CAPABILITY IMAP4rev1 UIDPLUS CHILDREN NAMESPACE THREAD=ORDEREDSUBJECT THREAD=REFERENCES SORT QUOTA IDLE ACL ACL2=UNION STARTTLS] Courier-IMAP ready. Copyright 1998-2011 Double Precision, Inc.  See COPYING for distribution information.
fetchmail: IMAP> A0001 CAPABILITY
fetchmail: IMAP< * CAPABILITY IMAP4rev1 UIDPLUS CHILDREN NAMESPACE THREAD=ORDEREDSUBJECT THREAD=REFERENCES SORT QUOTA IDLE ACL ACL2=UNION STARTTLS
fetchmail: IMAP< A0001 OK CAPABILITY completed
fetchmail: Protocol identified as IMAP4 rev 1
fetchmail: IMAP> A0002 STARTTLS
fetchmail: IMAP< A0002 OK Begin SSL/TLS negotiation now.
fetchmail: Certificate chain, from root to peer, starting at depth 1:
fetchmail: Issuer Organization: GlobalSign nv-sa
fetchmail: Issuer CommonName: GlobalSign Root CA
fetchmail: Subject CommonName: GlobalSign Domain Validation CA - SHA256 - G2
fetchmail: Certificate at depth 1:
fetchmail: Issuer Organization: GlobalSign nv-sa
fetchmail: Issuer CommonName: GlobalSign Root CA
fetchmail: Subject CommonName: GlobalSign Domain Validation CA - SHA256 - G2
fetchmail: Server certificate:
fetchmail: Issuer Organization: GlobalSign nv-sa
fetchmail: Issuer CommonName: GlobalSign Domain Validation CA - SHA256 - G2
fetchmail: Subject CommonName: muon.mfg-consulting-llc.com
fetchmail: Subject Alternative Name: muon.mfg-consulting-llc.com
fetchmail: muon.mfg-consulting-llc.com key fingerprint: 52:83:BD:F4:EB:72:70:1A:AA:3A:F9:13:65:9A:59:2E
fetchmail: muon.mfg-consulting-llc.com fingerprints match.
fetchmail: IMAP> A0003 CAPABILITY
fetchmail: IMAP< * CAPABILITY IMAP4rev1 UIDPLUS CHILDREN NAMESPACE THREAD=ORDEREDSUBJECT THREAD=REFERENCES SORT QUOTA IDLE AUTH=PLAIN ACL ACL2=UNION
fetchmail: IMAP< A0003 OK CAPABILITY completed
fetchmail: Protocol identified as IMAP4 rev 1
fetchmail: muon.mfg-consulting-llc.com: upgrade to TLS succeeded.
fetchmail: GSSAPI error gss_inquire_cred:  No credentials were supplied, or the credentials were unavailable or inaccessible.
fetchmail: GSSAPI error gss_inquire_cred: unknown mech-code 0 for mech unknown
fetchmail: No suitable GSSAPI credentials found. Skipping GSSAPI authentication.
fetchmail: If you want to use GSSAPI, you need credentials first, possibly from kinit.
fetchmail: IMAP> A0004 LOGIN "ger...@st..." *
fetchmail: IMAP< A0004 OK LOGIN Ok.
fetchmail: selecting or re-polling default folder
fetchmail: IMAP> A0005 SELECT "INBOX"
fetchmail: IMAP< * FLAGS (\Draft \Answered \Flagged \Deleted \Seen \Recent)
fetchmail: IMAP< * OK [PERMANENTFLAGS (\* \Draft \Answered \Flagged \Deleted \Seen)] Limited
fetchmail: IMAP< * 4 EXISTS
fetchmail: IMAP< * 0 RECENT
fetchmail: IMAP< * OK [UIDVALIDITY 403878125] Ok
fetchmail: IMAP< * OK [MYRIGHTS "acdilrsw"] ACL
fetchmail: IMAP< A0005 OK [READ-WRITE] Ok
fetchmail: 4 messages waiting after first poll
fetchmail: IMAP> A0006 SEARCH UNSEEN UNDELETED
fetchmail: IMAP< * SEARCH
fetchmail: IMAP< A0006 OK SEARCH done.
4 messages (4 seen) for ger...@st... at muon.mfg-consulting-llc.com.
fetchmail: IMAP> A0007 LOGOUT
fetchmail: IMAP< * BYE Courier-IMAP server shutting down
fetchmail: IMAP< A0007 OK LOGOUT completed
fetchmail: 6.3.26 querying muon.mfg-consulting-llc.com (protocol IMAP) at Sun Jul 20 14:44:58 2014: poll completed
New UID list from muon.mfg-consulting-llc.com: <empty>
fetchmail: not swapping UID lists, no UIDs seen this query
fetchmail: Query status=1 (NOMAIL)
fetchmail: normal termination, status 1

env LC_ALL=C fetchmail -V 

This is fetchmail release 6.3.26+GSS+RPA+NTLM+SDPS+SSL+OPIE+NLS.

Copyright (C) 2002, 2003 Eric S. Raymond
Copyright (C) 2004 Matthias Andree, Eric S. Raymond,
                   Robert M. Funk, Graham Wilson
Copyright (C) 2005 - 2012 Sunil Shetye
Copyright (C) 2005 - 2013 Matthias Andree
Fetchmail comes with ABSOLUTELY NO WARRANTY. This is free software, and you
are welcome to redistribute it under certain conditions. For details,
please see the file COPYING in the source or documentation directory.
This product includes software developed by the OpenSSL Project
for use in the OpenSSL Toolkit. (http://www.openssl.org/)

Fallback MDA: (none)
FreeBSD scorpio.seibercom.net 10.0-RELEASE-p3 FreeBSD 10.0-RELEASE-p3 #0: Tue May 13 18:31:10 UTC 2014     ro...@am...:/usr/obj/usr/src/sys/GENERIC  amd64
Taking options from command line and /home/gerard/.fetchmailrc
Idfile is /var/tmp/.fetchids
Fetchmail will forward misaddressed multidrop messages to postmaster.
Options for retrieving from ger...@st...@muon.mfg-consulting-llc.com:
  True name of server is muon.mfg-consulting-llc.com.
  Protocol is IMAP.
  All available authentication methods will be tried.
  SSL protocol: TLS1.
  SSL key fingerprint (checked against the server key): 52:83:BD:F4:EB:72:70:1A:AA:3A:F9:13:65:9A:59:2E
  Server nonresponse timeout is 30 seconds.
  Default mailbox selected.
  Only new messages will be retrieved (--all off).
  Fetched messages will be kept on the server (--keep on).
  Old messages will not be flushed before message retrieval (--flush off).
  Oversized messages will not be flushed before message retrieval (--limitflush off).
  Rewrite of server-local addresses is enabled (--norewrite off).
  Carriage-return stripping is disabled (stripcr off).
  Carriage-return forcing is disabled (forcecr off).
  Interpretation of Content-Transfer-Encoding is enabled (pass8bits off).
  MIME decoding is disabled (mimedecode off).
  Idle after poll is disabled (idle off).
  Nonempty Status lines will be kept (dropstatus off)
  Delivered-To lines will be discarded (dropdelivered on)
  Fetch message size limit is 100 (--fetchsizelimit 100).
  Do binary search of UIDs during 3 out of 4 polls (--fastuidl 4).
  Messages will be SMTP-forwarded to: localhost (default)
  Address to be put in RCPT TO lines shipped to SMTP will be st...@st...
  Single-drop mode: 1 local name recognized.
  No UIDs saved from this host.
  Messages with bad headers will be passed on.

I hope this is what you want.

-- 
Jerry

Re: [Fetchmail-users] Retrieving read messages from IMAP server

From: Matthias A. <mat...@gm...> - 2014-07-20 20:26:29

Am 20.07.2014 20:57, schrieb Jerry:
> On Sun, 20 Jul 2014 18:17:42 +0100, Rob MacGregor stated:
> 
>> On Sun, Jul 20, 2014 at 4:34 PM, Jerry <je...@se...> wrote:
>>> On Sun, 20 Jul 2014 15:57:02 +0100, Rob MacGregor stated:
>>>
>>> Yes, I have. Using MS Outlook 15.0.4631.1002 on my laptop. Outlook is
>>> configured to use IMAP for the account in question. I can go to the
>>> webmail site and confirm that the message is still there; however, it is
>>> marked as read. Fetchmail will not not download it. If I first use
>>> fetchmail to retrieve the email, it is also left on the site and Outlook
>>> will retrieve it. I figure I must have something configured incorrectly.
>>
>> Please see section G3 of the FAQ:
>> http://www.fetchmail.info/fetchmail-FAQ.html#G3
>>
>> It lists the information we need to help you. A transcript that
>> includes a failure to retrieve a message that's on the server would
>> help too.
> 
> env LC_ALL=C fetchmail --nodetach -vvv --nosyslog

Thank you.

Unfortunately the original fetchmail design - and still present with
IMAP - was that it assumed to be the only client polling the mailbox,
and hence can - as of 6.3.X - only be made to operate in either of these
modes:

- do not download mail another client has marked "seen"

- download and flush all mail, but this means the /other/ client only
has a few messages, and only as they accumulate before the next
fetchmail poll.

One workaround is - counter to other recommendations that are valid for
different situations or needs - to use POP3 + UIDL.

Fetchmail's IMAP client, as of 6.3.X, only downloads unseen mail, unless
you set --fetchall - but you cannot usefully combine fetchall and keep
because that would duplicate all mail.