isync-devel

"Flatten ." does not behave as expected

[Johannes R. <jo...@gm...>]

Dear all,

maybe I am missing someting, but I expected the "Flatten ." Maildir 
directive to cause all directories to be prepended with a "." in 
addition to "." being used as delimiter. My current Maildir, which is 
accessed by Dovecot has the layout:

Maildir/
               .folder
               .folder.subfolder


Obviously, this is the structure that dovecot expects.

However, mbsync creates the following structure:


Maildir/
             folder
             folder.subfolder

These folders are ignored by dovecot.

I have added "Flatten ." to the definition of the Maildir store, and I 
have found no separate directive to have the dot prepended. Can someone 
give me a headsup?

Cheers,

Johannes

Re: "Flatten ." does not behave as expected

[Oswald B. <osw...@gm...>]

On Mon, Mar 07, 2016 at 09:30:55AM +0100, Johannes Rohr wrote:
> I expected the "Flatten ." Maildir directive to cause all directories
> to be prepended with a "." in addition to "." being used as delimiter.
>
why would you?

you need to set Inbox, not Path, to ~/Maildir.

also, i'd recommend you use git master if you want real maildir++
compatibility.

see also https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=782054

Re: "Flatten ." does not behave as expected

[Johannes R. <jo...@gm...>]

Am 07.03.2016 um 09:50 schrieb Oswald Buddenhagen:
> On Mon, Mar 07, 2016 at 09:30:55AM +0100, Johannes Rohr wrote:
>> I expected the "Flatten ." Maildir directive to cause all directories
>> to be prepended with a "." in addition to "." being used as delimiter.
>>
> why would you?
>
> you need to set Inbox, not Path, to ~/Maildir.

I have set both, because without Path  I'm getting an error.

MaildirStore somename
Inbox ~/Maildir
Path ~/Maildir/
Flatten .

While syncing one remote store, the folders end up being synced without 
. preprended and therefore being ignored by dovecot, while from the 
other server, mails end up in ~/Maildir/INBOX.subfolder even though the 
INBOX path is specified to be ~/Maildir, not ~/Maildir/INBOX

Totally confused,

Johannes


>
> also, i'd recommend you use git master if you want real maildir++
> compatibility.
>
> see also https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=782054
>
>
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://makebettercode.com/inteldaal-eval
> _______________________________________________
> isync-devel mailing list
> isy...@li...
> https://lists.sourceforge.net/lists/listinfo/isync-devel

Re: "Flatten ." does not behave as expected

[Johannes R. <jo...@gm...>]

Am Mittwoch, den 09.03.2016, 16:14 +0100 schrieb Oswald Buddenhagen:
> On Wed, Mar 09, 2016 at 03:54:48PM +0100, Johannes Rohr wrote:
> > 
> > Am Mittwoch, den 09.03.2016, 15:13 +0100 schrieb Oswald
> > Buddenhagen:
> > > 
> > > Patterns *
> > > 
> > > try INBOX* instead.
> > I've tried that now. The good thing is: It doesn't throw an error.
> > The
> > bad thing is: it pulls in only the Inbox, but not the subfolders.
> > 
> hmpf.
> it might be that you need UseNamespace false to make it work.
Is this a deprecated parameter? 
/home/jr/.mbsyncrc:16: unknown keyword 'UseNamespace'
Cheers,
Johannes
> you can verify the recognized mailbox list with mbsync -l (and/or -DM).
> 
> 
> > 
> > I've now tried the following, which looks ugly but seems to work
> > nonetheless:
> > MaildirStore backup
> > Path ~/Maildir/.
> > Inbox ~/Maildir
> > Flatten . 
> > 
> > Note the trailing dot...
> > 
> > 

> 
> that was a common trick people used with older version of isync, but the
> number of cases where this would work (pretty much by accident) went
> down recently.
> but such hacks really shouldn't be necessary ...
> 
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> 
http://pubads.g.doubleclick.net/gampad/clk?id=278785111&iu=/4140
> 
> _______________________________________________
> isync-devel mailing list
> 
isy...@li...> 
https://lists.sourceforge.net/lists/listinfo/isync-devel> 

Re: "Flatten ." does not behave as expected

[Oswald B. <osw...@gm...>]

On Wed, Mar 09, 2016 at 04:21:54PM +0100, Johannes Rohr wrote:
> Am Mittwoch, den 09.03.2016, 16:14 +0100 schrieb Oswald Buddenhagen:
> > it might be that you need UseNamespace false to make it work.
> Is this a deprecated parameter? 
>
it's an imap store parameter.
you could have found that yourself by searching for it in the man page
...

> /home/jr/.mbsyncrc:16: unknown keyword 'UseNamespace'

Re: "Flatten ." does not behave as expected

[Johannes R. <jo...@gm...>]

Am 07.03.2016 um 09:50 schrieb Oswald Buddenhagen:
> On Mon, Mar 07, 2016 at 09:30:55AM +0100, Johannes Rohr wrote:
>> I expected the "Flatten ." Maildir directive to cause all directories
>> to be prepended with a "." in addition to "." being used as delimiter.
>>
> why would you?

Because the man page says:

     Note that flattened sub-folders of the INBOX always end
         up under Path, including the "INBOXdelim" prefix.

But somehow, this doesn't seem to be what is actually happening.

Johannes

>
> you need to set Inbox, not Path, to ~/Maildir.
>
> also, i'd recommend you use git master if you want real maildir++
> compatibility.
>
> see also https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=782054
>
>
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://makebettercode.com/inteldaal-eval
> _______________________________________________
> isync-devel mailing list
> isy...@li...
> https://lists.sourceforge.net/lists/listinfo/isync-devel

Re: "Flatten ." does not behave as expected

[Oswald B. <osw...@gm...>]

On Mon, Mar 07, 2016 at 10:07:21AM +0100, Johannes Rohr wrote:
> Am 07.03.2016 um 09:50 schrieb Oswald Buddenhagen:
> > On Mon, Mar 07, 2016 at 09:30:55AM +0100, Johannes Rohr wrote:
> >> I expected the "Flatten ." Maildir directive to cause all directories
> >> to be prepended with a "." in addition to "." being used as delimiter.
> >>
> > why would you?
> 
> Because the man page says:
> 
>      Note that flattened sub-folders of the INBOX always end
>          up under Path, including the "INBOXdelim" prefix.
> 
> But somehow, this doesn't seem to be what is actually happening.
> 
of course not. it doesn't say anything about prepending periods. it says
you'll get <Path>/INBOX.subfolder.subsub/ even if your Inbox is
configured to be /var/mail/jorohr/ (or something like that).

Re: "Flatten ." does not behave as expected

[Johannes R. <jo...@gm...>]

Am 07.03.2016 um 11:41 schrieb Oswald Buddenhagen:
> On Mon, Mar 07, 2016 at 09:58:29AM +0100, Johannes Rohr wrote:
>> Totally confused,
>>
> i won't bother explaining it and will reiterate:
>
>>> you need to set Inbox, not Path, to ~/Maildir.
> ... which will be entirely suffient if you follow this advice:
>
>>> also, i'd recommend you use git master if you want real maildir++
>>> compatibility.

I followed your advise, compiled the isync-git package on Arch, which 
does a fresh git pull at build time. When I don't set the path I get an 
error:

Maildir error: store 'backup' has no Path

Thanks

Johannes




> and don't play with Path and Flatten.
>
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://makebettercode.com/inteldaal-eval
> _______________________________________________
> isync-devel mailing list
> isy...@li...
> https://lists.sourceforge.net/lists/listinfo/isync-devel

Re: "Flatten ." does not behave as expected

[Johannes R. <jo...@gm...>]

Am 07.03.2016 um 17:56 schrieb Oswald Buddenhagen:
> On Mon, Mar 07, 2016 at 12:22:22PM +0100, Johannes Rohr wrote:
>> Am 07.03.2016 um 11:41 schrieb Oswald Buddenhagen:
>>> On Mon, Mar 07, 2016 at 09:58:29AM +0100, Johannes Rohr wrote:
>>>> Totally confused,
>>>>
>>> i won't bother explaining it and will reiterate:
>>>
>>>>> you need to set Inbox, not Path, to ~/Maildir.
>>> ... which will be entirely suffient if you follow this advice:
>>>
>>>>> also, i'd recommend you use git master if you want real maildir++
>>>>> compatibility.
>> I followed your advise, compiled the isync-git package on Arch, which
>> does a fresh git pull at build time. When I don't set the path I get an
>> error:
>>
>> Maildir error: store 'backup' has no Path
>>
> well, let's start with the full configuration file (redact as lightly as
> possible).

Here it is, of course, user name and password blanked out:

# Global configuration section
#   Values here are used as defaults for any following Channel section that
#   doesn't specify them.
Expunge None
Create Slave

MaildirStore backupdir
# Path ~/Maildir/
Inbox ~/Maildir/
# Flatten .
# Altmap No


IMAPStore imap
Host mail.jpberlin.de
User **************
Pass ************

Channel backup
Master :imap:
Slave :backupdir:
Create Slave
Patterns *
Sync Pull

> it would also help if you sketch the folder structure on the master, and
> what you want on the slave.

I don't have physical access to this master, it's a dovecot server. But 
since I can't verify I don't know what the file system looks like. In an 
IMAP client, all folder are subfolders of INBOX

~$ telnet mail.jpberlin.de imap
Trying 213.203.238.11...
Connected to mail.jpberlin.de.
Escape character is '^]'.
* OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE 
IDLE ACL UIDPLUS STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5 
AUTH=DIGEST-MD5] Dovecot ready. Master.


Locally, the layout is:

~/Maildir
                             cur
                             new
                             tmp
                             .subfolder
                             .subfolder.subsubfolder

That's the layout which dovecot recognises

my mbsync version is from git:

mbsync -v
isync 1.3.0

Still, if path is commented out I get an error message.

Thanks,

Johannes
>
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://makebettercode.com/inteldaal-eval
> _______________________________________________
> isync-devel mailing list
> isy...@li...
> https://lists.sourceforge.net/lists/listinfo/isync-devel

Re: "Flatten ." does not behave as expected

[Johannes R. <jo...@gm...>]

Am Mittwoch, den 09.03.2016, 15:13 +0100 schrieb Oswald Buddenhagen:
> On Wed, Mar 09, 2016 at 11:03:18AM +0100, Johannes Rohr wrote:
> > 


> Channel backup
> Master :imap:
> Slave :backupdir:
> Create Slave
> Patterns *
> 
> try INBOX* instead.
I've tried that now. The good thing is: It doesn't throw an error. The
bad thing is: it pulls in only the Inbox, but not the subfolders. 
I've now tried the following, which looks ugly but seems to work
nonetheless:
MaildirStore backup
Path ~/Maildir/.
Inbox ~/Maildir
Flatten . 
Note the trailing dot...
Thank you for your help..
Cheers,
Johannes
> > 
> > Sync Pull
> > 

> 
>  
> 
> 
> > 
> > > 
> > > it would also help if you sketch the folder structure on the master, and
> > > what you want on the slave.
> > > 

> > 
> > 
> > I don't have physical access to this master, it's a dovecot server.
> > 
> > 

> 
> i meant only the imap view of it, as that's obviously what matters to
> mbsync.
> 
> 
> > 
> > But since I can't verify I don't know what the file system looks like.
> > In an IMAP client, all folder are subfolders of INBOX
> > 
> > 

> 
> that's sufficient information.
> 
> 
> > 
> > ~$ telnet mail.jpberlin.de imap
> > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE 
> > IDLE ACL UIDPLUS STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5 
> > AUTH=DIGEST-MD5] Dovecot ready. Master.
> > 
> > 

> 
> oh my, you should shoot the admin. this server actually permits
> plaintext authentication without ssl ...
> 
> 
> ------------------------------------------------------------------------------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> 
http://pubads.g.doubleclick.net/gampad/clk?id=278785111&iu=/4140
> 
> _______________________________________________
> isync-devel mailing list
> 
isy...@li...> 
https://lists.sourceforge.net/lists/listinfo/isync-devel> 

Re: "Flatten ." does not behave as expected

[Oswald B. <osw...@gm...>]

On Mon, Mar 07, 2016 at 09:58:29AM +0100, Johannes Rohr wrote:
> Totally confused,
> 
i won't bother explaining it and will reiterate:

> > you need to set Inbox, not Path, to ~/Maildir.

... which will be entirely suffient if you follow this advice:

> > also, i'd recommend you use git master if you want real maildir++
> > compatibility.

and don't play with Path and Flatten.

Re: "Flatten ." does not behave as expected

[Oswald B. <osw...@gm...>]

On Mon, Mar 07, 2016 at 12:22:22PM +0100, Johannes Rohr wrote:
> Am 07.03.2016 um 11:41 schrieb Oswald Buddenhagen:
> > On Mon, Mar 07, 2016 at 09:58:29AM +0100, Johannes Rohr wrote:
> >> Totally confused,
> >>
> > i won't bother explaining it and will reiterate:
> >
> >>> you need to set Inbox, not Path, to ~/Maildir.
> > ... which will be entirely suffient if you follow this advice:
> >
> >>> also, i'd recommend you use git master if you want real maildir++
> >>> compatibility.
> 
> I followed your advise, compiled the isync-git package on Arch, which 
> does a fresh git pull at build time. When I don't set the path I get an 
> error:
> 
> Maildir error: store 'backup' has no Path
> 
well, let's start with the full configuration file (redact as lightly as
possible).
it would also help if you sketch the folder structure on the master, and
what you want on the slave.

Re: "Flatten ." does not behave as expected

[Oswald B. <osw...@gm...>]

On Wed, Mar 09, 2016 at 11:03:18AM +0100, Johannes Rohr wrote:
> # Global configuration section
> #   Values here are used as defaults for any following Channel section that
> #   doesn't specify them.
> Expunge None
> Create Slave
> 
> MaildirStore backupdir
> # Path ~/Maildir/
> Inbox ~/Maildir/
>
no trailing slash here (though it may not matter in this place).

> # Flatten .
> # Altmap No
> 
> 
> IMAPStore imap
> Host mail.jpberlin.de
> User **************
> Pass ************
> 
> Channel backup
> Master :imap:
> Slave :backupdir:
> Create Slave
> Patterns *
>
try INBOX* instead.

> Sync Pull
 

> > it would also help if you sketch the folder structure on the master, and
> > what you want on the slave.
> 
> I don't have physical access to this master, it's a dovecot server.
>
i meant only the imap view of it, as that's obviously what matters to
mbsync.

> But since I can't verify I don't know what the file system looks like.
> In an IMAP client, all folder are subfolders of INBOX
> 
that's sufficient information.

> ~$ telnet mail.jpberlin.de imap
> * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE 
> IDLE ACL UIDPLUS STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=CRAM-MD5 
> AUTH=DIGEST-MD5] Dovecot ready. Master.
> 
oh my, you should shoot the admin. this server actually permits
plaintext authentication without ssl ...

Re: "Flatten ." does not behave as expected

[Oswald B. <osw...@gm...>]

On Wed, Mar 09, 2016 at 03:54:48PM +0100, Johannes Rohr wrote:
> Am Mittwoch, den 09.03.2016, 15:13 +0100 schrieb Oswald Buddenhagen:
> > Patterns *
> > 
> > try INBOX* instead.
>
> I've tried that now. The good thing is: It doesn't throw an error. The
> bad thing is: it pulls in only the Inbox, but not the subfolders.
>
hmpf.
it might be that you need UseNamespace false to make it work.

you can verify the recognized mailbox list with mbsync -l (and/or -DM).

> I've now tried the following, which looks ugly but seems to work
> nonetheless:
> MaildirStore backup
> Path ~/Maildir/.
> Inbox ~/Maildir
> Flatten . 
>
> Note the trailing dot...
>
that was a common trick people used with older version of isync, but the
number of cases where this would work (pretty much by accident) went
down recently.
but such hacks really shouldn't be necessary ...

Re: "Flatten ." does not behave as expected

[Johannes R. <jo...@gm...>]

So I specified UseNamespace no under the Imap store and 
SubFolders Maildir++ under the maildir store
(which is apparently what I was looking all the time)
Now it works!
Johannes
Am Mittwoch, den 09.03.2016, 16:14 +0100 schrieb Oswald Buddenhagen:
> On Wed, Mar 09, 2016 at 03:54:48PM +0100, Johannes Rohr wrote:
> > 
> > Am Mittwoch, den 09.03.2016, 15:13 +0100 schrieb Oswald
> > Buddenhagen:
> > > 
> > > Patterns *
> > > 
> > > try INBOX* instead.
> > I've tried that now. The good thing is: It doesn't throw an error.
> > The
> > bad thing is: it pulls in only the Inbox, but not the subfolders.
> > 
> hmpf.
> it might be that you need UseNamespace false to make it work.
> 
> you can verify the recognized mailbox list with mbsync -l (and/or
> -DM).
> 
> > 
> > I've now tried the following, which looks ugly but seems to work
> > nonetheless:
> > MaildirStore backup
> > Path ~/Maildir/.
> > Inbox ~/Maildir
> > Flatten . 
> > 
> > Note the trailing dot...
> > 
> that was a common trick people used with older version of isync, but
> the
> number of cases where this would work (pretty much by accident) went
> down recently.
> but such hacks really shouldn't be necessary ...
> 
> -------------------------------------------------------------------
> -----------
> Transform Data into Opportunity.
> Accelerate data analysis in your applications with
> Intel Data Analytics Acceleration Library.
> Click to learn more.
> http://pubads.g.doubleclick.net/gampad/clk?id=278785111&iu=/4140
> _______________________________________________
> isync-devel mailing list
> isy...@li...
> https://lists.sourceforge.net/lists/listinfo/isync-devel