#384 High memory usage

[Anonymous]

Davmail Gateway 3.9.6, OSX 10.7.2
DavMail active memory quickly grows to over 500MB real memory (according to Activity Montitor) and stays there, causing lots of swapping and generally slow performance. This may be a regression - I hadn't noticed this in earlier versions (I think I was using 3.9.3 last).

[Mickael Guessant]

Did this happen only on Lion or also on Snow Leopard ?

Can you try to switch back to 3.9.3 temporarily ?

[Anonymous]

"me too": Using DavMail 3.9.6 (installed 3 days ago) I'm experiencing huge memory consumption over 300MB of physical memory (not virtual). OSX Lion, Client: Mail.app, Server: SBS2003, not using EWS but WebDAV. Exchange Mailbox is very large (more than 15,000 items and over 4GB of mailbox size). But even after first initial sync and rebooting, DavMail always rises memory consumption up to more than 300MB while syncing with server. and doesn't turn back to lower usage after syncing is finished.

Didn't use earlier versions of DavMail, and not on earlier versions of OS X, so I can't compare.

Does 3.9.3 run on Lion...? So I would try a downgrade.

[Mickael Guessant]

Is there a way to run DavMail in 32 bits mode, as in:
http://devnet.jetbrains.net/docs/DOC-1232
?

[Anonymous]

No, I haven't a checkbox to activate the 32-bit mode in the file info of DavMail.

[Mickael Guessant]

Should be better with 3.9.7

[Anonymous]

577m resident size here (over 800m committed)
version: 3.9.7-1870

[Mickael Guessant]

OSX or Windows ?
WebDav or EWS mode ?

[Anonymous]

Ubuntu 11.10 and 10.04.4
What's EWS? I guess WebDav then.

[Anonymous]

Hmm...looking at VisualVM dump it seems that davmail.exchange.dav.DavExchangeSession$Message are not collected properly: before full GC I have more than 32k instances after GC - only 1.2k
Full GC drops the memory usage to the normal 50Mb, and then it starts climbing.

[Mickael Guessant]

The fact that you get a lot of Message instances is normal, however there should be only one instance with full content in memory per IMAP connection. How many active connections do you have ?

[Anonymous]

Hmm, Thunderbird uses 4 connections at the same time.
I have reduced "number of connections to cache" to 1 in Thunderbird settings.
Let's wait and see if it helps.

[Anonymous]

It seems like thunderbird is raping davmail with thousands of fetches for very old mail
It looks like davmail is not answering with what thunderbird expects, because it downloads same old messages over and over for each "check for new mail" run.

[Mickael Guessant]

You probably found the root cause of your issue. Do you see any errors during message FETCH ?

[Anonymous]

I see this in davmail log:
2012-02-14 20:11:17,019 DEBUG [ImapConnection-41742] davmail.exchange.ExchangeSession - Contenttag changed on INBOX 2012-02-14T18:09:54.000Z => 2012-02-14T18:10:40.016Z, reloading messages

And then it indeed reloads 29k messages in Inbox.

[Anonymous]

I think I found the flow. Thunderbird is set to delete messages older than a year, when it deletes message davmail reloads the whole mailbox.

[Mickael Guessant]

Contenttag changed triggers message list update, not full message download.
Message delete is another story: over IMAP delete is a multi step process:
- mark message \Deleted
- expunge folder

Is imapAutoExpunge enabled in your DavMail settings ?