Menu

#88 Z-push 2.1.2 & backend 59, loop in Calendar

unconfirmed
closed
nobody
None
1
2014-10-20
2014-05-16
salva_savia
No

Hello,

I have installed Zimbra ZCS 8.0.7 in producction . In another server I have Z- Push 2.1.2 and Zimbra Backend 59 .

I have a Samsung Galaxy S4 zpush configured with Microsoft Exchange Server ActiveSync to synchronize the calendar , contacts and email .

It's working fine a week or two and suddenly my calendar appointments began to be duplicated growing to 323 in the same day quotes, this makes calendar crash and the battery is consume.

In the log of the z -push only have over and over this line

16/5/2014 8:54:08 [ 11018 ] [INFO ] [ abarbera@savia.net ] ExportChangesDiff -> InitializeExporter (): Found '131 'changes
16/5/2014 8:54:08 [ 11018 ] [ WARN ] [ abarbera@savia.net ] Mobile loop detected! Messages sent to the mobile will be restricted to 1 items in order to identify identity the conflict
16/5/2014 8:54:31 [ 11017 ] [INFO ] [ abarbera@savia.net ] .1.2-1873 Version = '2 ' method = ' POST ' from = '213 .143.46.94 ' cmd = ' Sync' getUser = ' abarbera@savia.net ' devid = ' androidc1141671377 ' DEVTYPE = 'Android'

This happens to me and two other people in company , I have others not happens ... How can I identify the problem ?

Discussion

  • LiverpoolFCfan

    LiverpoolFCfan - 2014-05-16

    Did you make the change to diffstate.php as specified in the INSTALL File. Not making this change is the most common reason for looping to occur.

     
  • salva_savia

    salva_savia - 2014-05-16

    Yes, I did.

     
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-05-16

    You will need to get a WBXML level log file to try to isolate the issue. Set the log level to loglevel_WBXML in the z-push config.php file

    define('LOGLEVEL', LOGLEVEL_WBXML);
    

    and capture a log and post it. If you don't want to post it on here click on my account to the left to get to my profile page, and use the send a message link to send me a PM. Include a real email address that you use and I will contact you back.

     
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-05-18

    Can you also describe your complete configuration.

    Do you have a single zimbra server? Is the NginX proxy installed?

     
  • salva_savia

    salva_savia - 2014-05-19

    I deleted zPUSH status of the problematic accounts. And when it works. It so happens that the two problematic accounts are configured on two different devices, in my case my account had in my phone and my tablet.
    The other problematic account is also in two devices coincidentally, the rest are only on one device and have had no problems. I'll see if having it on one device I reproduce the problem. So far the weekend is going well.
    If it fails again will try to extract the log and tell you.
    There is a problem known to have one account on two devices?

     
  • salva_savia

    salva_savia - 2014-05-19

    By the way my installation is on a single server without proxy enabled.

     
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-05-19

    One account on 2 devices should not cause any problems. Two accounts on the same device will not work though - it will cause problems. I have submitted a possible fix for that problem but it has not been evaluated as yet by the z-push team.

     
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-05-19

    Actually, if you have multiple devices synching against accounts, be sure to read the following:

    There is a potential issue with the number of allowed SOAP sessions per user. This was highlighted in a ticket and was fixed in zimbra release 7.2 and later - where you can now increase the number.
    https://bugzilla.zimbra.com/show_bug.cgi?id=75338 ; Providing the ability to increase the number of Soap sessions
    I set the value to 7 on my server and typically don't see the issue any more.

     
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-05-25

    Did you make the suggested change on zimbra? Has it helped? Do you still need help?

     
    • salva_savia

      salva_savia - 2014-05-26

      Like I said suspected the problem came from having my account on two devices. I deleted my account from my tablet and delete and create my account on my phone deleting my file server status. Wear two weeks and seems to work well. My next step will be to create my account again on my tablet and see if the error is reproduced.
      If so generare log you told me and it will analyze.

      Thanks and regards.

      ----- Mensaje original -----

      De: "LiverpoolFCfan" liverpoolfcfan@users.sf.net
      Para: "[zimbrabackend:bugs]" 40@bugs.zimbrabackend.p.re.sf.net
      Enviados: Domingo, 25 de Mayo 2014 23:31:28
      Asunto: [zimbrabackend:bugs] #40 Z-push 2.1.2 & backend 59, loop in Calendar

      Did you make the suggested change on zimbra? Has it helped? Do you still need help?

      [bugs:#40] Z-push 2.1.2 & backend 59, loop in Calendar

      Status: open
      Group: unconfirmed
      Created: Fri May 16, 2014 07:37 AM UTC by salva_savia
      Last Updated: Mon May 19, 2014 08:26 AM UTC
      Owner: nobody

      Hello,

      I have installed Zimbra ZCS 8.0.7 in producction . In another server I have Z- Push 2.1.2 and Zimbra Backend 59 .

      I have a Samsung Galaxy S4 zpush configured with Microsoft Exchange Server ActiveSync to synchronize the calendar , contacts and email .

      It's working fine a week or two and suddenly my calendar appointments began to be duplicated growing to 323 in the same day quotes, this makes calendar crash and the battery is consume.

      In the log of the z -push only have over and over this line

      16/5/2014 8:54:08 [ 11018 ] [INFO ] [ abarbera@savia.net ] ExportChangesDiff -> InitializeExporter (): Found '131 'changes
      16/5/2014 8:54:08 [ 11018 ] [ WARN ] [ abarbera@savia.net ] Mobile loop detected! Messages sent to the mobile will be restricted to 1 items in order to identify identity the conflict
      16/5/2014 8:54:31 [ 11017 ] [INFO ] [ abarbera@savia.net ] .1.2-1873 Version = '2 ' method = ' POST ' from = '213 .143.46.94 ' cmd = ' Sync' getUser = ' abarbera@savia.net ' devid = ' androidc1141671377 ' DEVTYPE = 'Android'

      This happens to me and two other people in company , I have others not happens ... How can I identify the problem ?

      Sent from sourceforge.net because you indicated interest in https://sourceforge.net/p/zimbrabackend/bugs/40/

      To unsubscribe from further messages, please visit https://sourceforge.net/auth/subscriptions/

      --

      Salvador Lorenzo Garcés - Responsable de sistemas y telecomunicaciones
      Savia: Soluciones Eficaces para la Gestión de Personas
      Doctor Zamenhof, 36 - 2ª Planta - 28027 MADRID - Telf.: 902 11 93 15 - Mov.: 699435729

      Skype: twitter.com/Savia_twitts
      Web: www.savia.net
      Flick r: www.flickr.com/photos/savianet
      You Tube: http://www.youtube.com/saviatv
      Twitter: twitter.com/Savia_twitts

       
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-05-26

    OK. I will leave the ticket open while you try it.

    Do follow the instructions in the bugzilla referenced 3 posts up to increase the number of SOAP sessions available for accounts on your server to make sure you don't have sessions terminating unexpectedly.

     
    • salva_savia

      salva_savia - 2014-05-27

      Hi,

      Recently I had to include the IP address of the zPUSH server in whitelist of zimbra following this howto http://wiki.zimbra.com/wiki/DoSFilter because I had problems with the chat module of Zextras

      This fact may cause the problem I'm having?

      I will set up my account on my tablet back to see if the error occurs

      Thanks.

      ----- Mensaje original -----

      De: "LiverpoolFCfan" liverpoolfcfan@users.sf.net
      Para: "[zimbrabackend:bugs]" 40@bugs.zimbrabackend.p.re.sf.net
      Enviados: Lunes, 26 de Mayo 2014 22:41:23
      Asunto: [zimbrabackend:bugs] #40 Z-push 2.1.2 & backend 59, loop in Calendar

      OK. I will leave the ticket open while you try it.

      Do follow the instructions in the bugzilla referenced 3 posts up to increase the number of SOAP sessions available for accounts on your server to make sure you don't have sessions terminating unexpectedly.

      [bugs:#40] Z-push 2.1.2 & backend 59, loop in Calendar

      Status: open
      Group: unconfirmed
      Created: Fri May 16, 2014 07:37 AM UTC by salva_savia
      Last Updated: Sun May 25, 2014 09:31 PM UTC
      Owner: nobody

      Hello,

      I have installed Zimbra ZCS 8.0.7 in producction . In another server I have Z- Push 2.1.2 and Zimbra Backend 59 .

      I have a Samsung Galaxy S4 zpush configured with Microsoft Exchange Server ActiveSync to synchronize the calendar , contacts and email .

      It's working fine a week or two and suddenly my calendar appointments began to be duplicated growing to 323 in the same day quotes, this makes calendar crash and the battery is consume.

      In the log of the z -push only have over and over this line

      16/5/2014 8:54:08 [ 11018 ] [INFO ] [ abarbera@savia.net ] ExportChangesDiff -> InitializeExporter (): Found '131 'changes
      16/5/2014 8:54:08 [ 11018 ] [ WARN ] [ abarbera@savia.net ] Mobile loop detected! Messages sent to the mobile will be restricted to 1 items in order to identify identity the conflict
      16/5/2014 8:54:31 [ 11017 ] [INFO ] [ abarbera@savia.net ] .1.2-1873 Version = '2 ' method = ' POST ' from = '213 .143.46.94 ' cmd = ' Sync' getUser = ' abarbera@savia.net ' devid = ' androidc1141671377 ' DEVTYPE = 'Android'

      This happens to me and two other people in company , I have others not happens ... How can I identify the problem ?

      Sent from sourceforge.net because you indicated interest in https://sourceforge.net/p/zimbrabackend/bugs/40/

      To unsubscribe from further messages, please visit https://sourceforge.net/auth/subscriptions/

      --

      Salvador Lorenzo Garcés - Responsable de sistemas y telecomunicaciones
      Savia: Soluciones Eficaces para la Gestión de Personas
      Doctor Zamenhof, 36 - 2ª Planta - 28027 MADRID - Telf.: 902 11 93 15 - Mov.: 699435729

      Skype: twitter.com/Savia_twitts
      Web: www.savia.net
      Flick r: www.flickr.com/photos/savianet
      You Tube: http://www.youtube.com/saviatv
      Twitter: twitter.com/Savia_twitts

       
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-05-27

    That issue is called out in the INSTALL notes for the zimbra backend too.

     
    • salva_savia

      salva_savia - 2014-06-03

      I just wanted to inform you that I have 2 weeks working with my tablet and synchronized with mobile zPUSH and has not become me to reproduce the problem.
      Do not know if there will be resolved by modifying the whitelist or delete zimbra of zPUSH states, the fact is that everything seems to work ok.
      thanks

      ----- Mensaje original -----

      De: "LiverpoolFCfan" liverpoolfcfan@users.sf.net
      Para: "[zimbrabackend:bugs]" 40@bugs.zimbrabackend.p.re.sf.net
      Enviados: Martes, 27 de Mayo 2014 18:00:27
      Asunto: [zimbrabackend:bugs] #40 Z-push 2.1.2 & backend 59, loop in Calendar

      That issue is called out in the INSTALL notes for the zimbra backend too.

      [bugs:#40] Z-push 2.1.2 & backend 59, loop in Calendar

      Status: open
      Group: unconfirmed
      Created: Fri May 16, 2014 07:37 AM UTC by salva_savia
      Last Updated: Mon May 26, 2014 08:41 PM UTC
      Owner: nobody

      Hello,

      I have installed Zimbra ZCS 8.0.7 in producction . In another server I have Z- Push 2.1.2 and Zimbra Backend 59 .

      I have a Samsung Galaxy S4 zpush configured with Microsoft Exchange Server ActiveSync to synchronize the calendar , contacts and email .

      It's working fine a week or two and suddenly my calendar appointments began to be duplicated growing to 323 in the same day quotes, this makes calendar crash and the battery is consume.

      In the log of the z -push only have over and over this line

      16/5/2014 8:54:08 [ 11018 ] [INFO ] [ abarbera@savia.net ] ExportChangesDiff -> InitializeExporter (): Found '131 'changes
      16/5/2014 8:54:08 [ 11018 ] [ WARN ] [ abarbera@savia.net ] Mobile loop detected! Messages sent to the mobile will be restricted to 1 items in order to identify identity the conflict
      16/5/2014 8:54:31 [ 11017 ] [INFO ] [ abarbera@savia.net ] .1.2-1873 Version = '2 ' method = ' POST ' from = '213 .143.46.94 ' cmd = ' Sync' getUser = ' abarbera@savia.net ' devid = ' androidc1141671377 ' DEVTYPE = 'Android'

      This happens to me and two other people in company , I have others not happens ... How can I identify the problem ?

      Sent from sourceforge.net because you indicated interest in https://sourceforge.net/p/zimbrabackend/bugs/40/

      To unsubscribe from further messages, please visit https://sourceforge.net/auth/subscriptions/

      --

      Salvador Lorenzo Garcés - Responsable de sistemas y telecomunicaciones
      Savia: Soluciones Eficaces para la Gestión de Personas
      Doctor Zamenhof, 36 - 2ª Planta - 28027 MADRID - Telf.: 902 11 93 15 - Mov.: 699435729

      Skype: twitter.com/Savia_twitts
      Web: www.savia.net
      Flick r: www.flickr.com/photos/savianet
      You Tube: http://www.youtube.com/saviatv
      Twitter: twitter.com/Savia_twitts

       
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-06-03

    Happy to hear everything is still working well.

    The short answer is it could be either.

    I know from troubleshooting that not whitelisting the z-push server is a huge problem on zimbra 8 systems. It can stop communications between z-push and zimbra for long periods of time. You should be able to find evidence of this in your zimbra and z-push logs if it is happening.

    But, I have also seen instances where the z-push cache just gets out-of-sync for a mobile for some non-obvious reason, and the only way to clear it is to remove the account/remove the device from z-push/re-add the account.

    Do you need any more help on this? Or will I close the ticket?

     
    • salva_savia

      salva_savia - 2014-06-03

      No, you can close ticket, at the moment its working fine

      Thanks.

      ----- Mensaje original -----

      De: "LiverpoolFCfan" liverpoolfcfan@users.sf.net
      Para: "[zimbrabackend:bugs]" 40@bugs.zimbrabackend.p.re.sf.net
      Enviados: Martes, 3 de Junio 2014 14:54:04
      Asunto: [zimbrabackend:bugs] #40 Z-push 2.1.2 & backend 59, loop in Calendar

      Happy to hear everything is still working well.

      The short answer is it could be either.

      I know from troubleshooting that not whitelisting the z-push server is a huge problem on zimbra 8 systems. It can stop communications between z-push and zimbra for long periods of time. You should be able to find evidence of this in your zimbra and z-push logs if it is happening.

      But, I have also seen instances where the z-push cache just gets out-of-sync for a mobile for some non-obvious reason, and the only way to clear it is to remove the account/remove the device from z-push/re-add the account.

      Do you need any more help on this? Or will I close the ticket?

      [bugs:#40] Z-push 2.1.2 & backend 59, loop in Calendar

      Status: open
      Group: unconfirmed
      Created: Fri May 16, 2014 07:37 AM UTC by salva_savia
      Last Updated: Tue May 27, 2014 04:00 PM UTC
      Owner: nobody

      Hello,

      I have installed Zimbra ZCS 8.0.7 in producction . In another server I have Z- Push 2.1.2 and Zimbra Backend 59 .

      I have a Samsung Galaxy S4 zpush configured with Microsoft Exchange Server ActiveSync to synchronize the calendar , contacts and email .

      It's working fine a week or two and suddenly my calendar appointments began to be duplicated growing to 323 in the same day quotes, this makes calendar crash and the battery is consume.

      In the log of the z -push only have over and over this line

      16/5/2014 8:54:08 [ 11018 ] [INFO ] [ abarbera@savia.net ] ExportChangesDiff -> InitializeExporter (): Found '131 'changes
      16/5/2014 8:54:08 [ 11018 ] [ WARN ] [ abarbera@savia.net ] Mobile loop detected! Messages sent to the mobile will be restricted to 1 items in order to identify identity the conflict
      16/5/2014 8:54:31 [ 11017 ] [INFO ] [ abarbera@savia.net ] .1.2-1873 Version = '2 ' method = ' POST ' from = '213 .143.46.94 ' cmd = ' Sync' getUser = ' abarbera@savia.net ' devid = ' androidc1141671377 ' DEVTYPE = 'Android'

      This happens to me and two other people in company , I have others not happens ... How can I identify the problem ?

      Sent from sourceforge.net because you indicated interest in https://sourceforge.net/p/zimbrabackend/bugs/40/

      To unsubscribe from further messages, please visit https://sourceforge.net/auth/subscriptions/

      --

      Salvador Lorenzo Garcés - Responsable de sistemas y telecomunicaciones
      Savia: Soluciones Eficaces para la Gestión de Personas
      Doctor Zamenhof, 36 - 2ª Planta - 28027 MADRID - Telf.: 902 11 93 15 - Mov.: 699435729

      Skype: twitter.com/Savia_twitts
      Web: www.savia.net
      Flick r: www.flickr.com/photos/savianet
      You Tube: http://www.youtube.com/saviatv
      Twitter: twitter.com/Savia_twitts

       
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-06-03

    Ticket moved from /p/zimbrabackend/bugs/40/

     
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-06-03
    • status: open --> closed
     
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-06-03

    Moved ticket to Support Requests.

    Closing ticket as whitelisting z-push server on zimbra, and removing the devices from z-push and re-adding them has cleared the issue.

     
  •  

      - 2014-06-27

    Not intending to highjack a closed ticket but i am currently facing the exact same (well, almost) problem with an account under Android 4.4.4 and it pretty much started out of nowhere.

    Z-Push is 2.1.2-1873 w/ Backend 60 (the Problem started in the middle of running 59, and i did hope to get this sorted out with upgrading)

    As it stands the problem starts exactly 24 hours after adding the account with:

    ExportChangesDiff -> InitializeExporter (): Found 'x' changes (where x is the number of messages received between the phones configured retention and now)

    spamming the z-push.log over and over and over again and Android trying to "sync" mail for this account until the battery runs dry.

    The only way to get it working again is by removing the account from the phone and the device from z-push and re-adding it, until it starts all over after 24 hours.

    I didn't try to "clear" the state directory of the failing device yet as salva_savia mentioned, i am going to try this tomorrow once i have more time to dig around, but i did try z-push-admin.php -a fixstates and clearloop without success.

    The modification to diffstate.php was applied (as i said, this setup "was" working fine)
    I temporary (for around two days) added the local IP of the Zimbra server and the local IP of my Proxy to zimbraHttpThrottleSafeIPs as the z-push-error.log was showing 503s, but after further digging this was imho caused by the phone hammering the server due to the above problem causing the threshold to be reached.

    As i stated, i am running a proxy with nginx on a separate server outside my LAN/inside the DMZ serving request via virtual-servers forwarding to local services including Zimbra/z-push.

    The account having the issue also has multiple devices, well...the second "device" is Windows 8.1 running Outlook 2013 (now will writing this, i did reinstall the Workstation/Outlook and if i am not totally mistaken the problem started around this time...coincident?!)

    Maybe i should remove the Outlook device from z-push, only add the Android and see if the account survives 24 hours without hitting the loop...well, tomorrow.

     
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-06-27

    It is not possible to say you have an identical issue without logs to show what is happening in your environment. There is a fix in 2.1.3 of z-push that affects android 4.4.2 on HTC that might also be needed for your version? I would suggest you try that first.

    Did you upgrade to 2.1.x from 2.0.x ? If so, did you run the migration script on your z-push data?

    Have you tried a resync request for the device/account from the z-push-admin.php tool ?

    If you do decide to remove the account from a device, make sure you remove the z-push info associated from the cache too
    z-push-admin.php -a remove -d deviceid -u user
    z-push-admin.php -a remove -d deviceid
    and finally delete any left over files in the cache folder for the device. Folder can contain files for multiple devices - from cache root look for a folder named for the last character of the device id. Within that look for a folder named for the 2nd last character in the device id. Within that folder all files are prefixed with the device id. If any are left over for your device id, get rid of them.
    Then re-add the account.

    If you still have an issue, please open a new ticket. Thanks.

     
  •  

      - 2014-07-04

    Thanks for the prompt response.

    Well, looks like i sorted this one out...

    Since removing the Users Outlook "device" from Z-Push and any leftover files in /var/lib/z-push from it, leaving only his Android device registered, gave me the exact same loop after 24 hours i did run a manual resync on it using:

    z-push-admin.php -a resync -u User -d AndroidDeviceID

    will tailing /var/log/z-push.log which showed some "damaged" messages with a malformed sender including German Umlauts.

    The device was syncing again after running the manual resync but failed again after 24 hours which lead me to do another manual resync, but this time i removed every "damaged" message z-push.log was complaining about from the users inbox, which seems to have fixed the problem for good.

    36 hours and the device is still syncing just fine, will z-push.log doesn't show anything unusual.

    Fingers crossed.

    Might be useful to know in case someone is running into the same problem.

    Cheers

     
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-07-04

    I have seen a post in the last few days where someone with a Blackberry issue was also saying they had issues with Broken Messages with German Umlauts. So that may be a core z-push issue.

    Is it in the Sender's name? Or in the email address ?

    If you can post some examples, I can try to see if I can generate a test to see if there is anything I can do with them.

     
  •  

      - 2014-07-04

    Exam of my z-push.log will running 'z-push-admin.php -a resync ...' on the users device:

    02/07/2014 00:08:05 [ 1104] [WARN] [User] SyncObject->Check(): object from type SyncMail: parameter 'from' contains an invalid email address '"=?iso-8859-1?Q?XXXXX XX=F6XX?=" =?iso-8859-1?Q?XXXXX XX=F6XX?=@sub.domain.tld>'. Address is removed.

    For every "damaged" message, all where originating from the same system.

    I obfuscated the senders name and mail address with X's, replaced the hostname with sub.domain.tld and replaced my users name with User.

    The =F6 was the German Umlaut ö and all affected Messages were read reciepts generated by a Postfix installation.

    That's pretty much what i could dig up so far.

    Agreeing on the Z-Push core part, so double thanks for taking care of it!

     
  • LiverpoolFCfan

    LiverpoolFCfan - 2014-07-06

    Please send me a message by clicking on my username to the left of this window and using the Send a Message link.

    Include a real email address where you can be contacted. I will reply from an email account to where you ca send me a z-push.log file privately to investigate this properly. I cannot tell if the log lines show a valid address or not due to your manipulation of the content (which I understand your reasons for of course).

    Vincent

     

Log in to post a comment.