Re: occasional "Warning: lost track of 460840 pulled message(s)"

[Uwe Kleine-K. <uwe...@kl...>]

Hello Oswald,

On 9/8/21 22:44, Oswald Buddenhagen wrote:
> On Wed, Sep 08, 2021 at 04:48:25PM +0200, Uwe Kleine-König wrote:
>> On 9/8/21 10:15 AM, Oswald Buddenhagen wrote:
>>> the notable thing here is that you have *a lot* more messages on the
>>> client than there are on the server. given your symmetrical
>>> configuration, mbsync should try to upload them all in the next run, and
>>> if it loses track again, it would keep ballooning up.
>>
>> I don't know what these numbers mean.
> 
>> Is the goal of the symmetrical sync that the numbers for slave and 
>> master match?
>>
> yes.
> though i checked again, and your configuration doesn't specify
> expunging, so trashed/deleted messages are piling up. the question would
> still be still why the server has so many less. it might be doing some
> auto-expunging.

After some time I looked into that again. Currently I have:

Nov 08 11:02:45 taurus syncmail-work[66155]: slave: 4922595 messages, 
519622 recent
Nov 08 11:02:52 taurus syncmail-work[66155]: master: 536546 messages, 0 
recent

On the local machine I have:

$ find cur new  -type f | sed -r 's/.*,//; s/U=[0-9]*/U=/' | sort | uniq -c
  727631
     891 RS
    6770 RST
   10275 S
   84686 ST
4091947 T
     395 U=

on the remote machine it's:

$ find cur new  -type f | sed s/.*,// | sort | uniq -c
  525693
       1 a
     858 RS
    9994 S

So the trashed (T) mails indeed make a big difference, though they don't 
explain the complete difference.

Looking at one of the trashed mails, I have:

$ notmuch-work search --output=files id:20160305041443.GA15110@localhost
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1591260203.24229_6060.taurus,U=96624:2,T
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1596451602.12728_95550.taurus,U=527455:2,T
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1599137440.15600_95548.taurus,U=966567:2,T
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1604437795.202088_80663.taurus,U=1422581:2,T
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1617249920.248609_5852.taurus,U=1912907:2,T
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1620799244.1020789_95549.taurus,U=2411398:2,T
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1624702521.223072_86474.taurus,U=2920641:2,T
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1628056501.1555639_39006.taurus,U=3437967:2,T
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1629352809.326495_40438.taurus,U=3958232:2,T
/home/uwe/Maildir-work/.lists.linux-arm-kernel/new/1631031224.213028_95548.taurus,U=4481897:2,

So this mail is there several times, the only difference between two of 
them is:

$ diff 
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1591260203.24229_6060.taurus,U=96624:2,T 
/home/uwe/Maildir-work/.lists.linux-arm-kernel/cur/1596451602.12728_95550.taurus,U=527455:2,T
85c85
< X-TUID: Dt8UrWnhpxMb
---
 > X-TUID: dFc6WopZteE0

Does that mean that the UID the server used for this mail changed?

Best regards
Uwe