CalSync V1.7 not adding ALL Lotus events

2010-11-26
2013-04-29
1 2 > >> (Page 1 of 2)
  • Tim McIntyre
    Tim McIntyre
    2010-11-26

    Hi,

    I've been using CalSync V1.6 for awhile now, and so far am very very happy with it :)

    Just updated to the newest version (V1.7.1545) and found that it would not add all of my Lotus notes events to Google…
    Did a quick search on the forums here and found a similar topic https://sourceforge.net/projects/lntogoogle/forums/forum/1072333/topic/3892943 that had ZERO meetings being added.
    The solution to that issue was something to do with the date format, and has been fixed in V1.7.1545…

    My issue is that only some of the Lotus events are added, whether they be meetings, reminders or appointments, and some do not.

    To test this I added two new events in Lotus, 1 meeting and 1 appointment;

    Ran V1.7 and tried to sync to Goolgle, 49 events were found and synced.
    Un-installed V1.7, installed and ran V1.6 and 52 events were found and synced…
    Same date range, same general settings etc.

    I've also noticed that the "Privacy settings" in CalSync don't seem to stop private meetings being synced into Google…
    Not sure if this is related (or if I'm setting it correctly) but just thought I'd note it.

    Any info would be great!!

    Cheers

    Tim

     
  • lidsinker
    lidsinker
    2010-11-27

    I've had a few people mention similar problems with 1.7 and above.  I'm not exactly sure what the problem is.  I'm not in front of the code right now so I'll take a look this upcoming week and post back here.

    As for "Private" meetings, can you right-click on a private meeting in Lotus Notes and look at the Document Properties.  Find the OrgConfidential property and see if it is set to "1" for private meetings and "0" or empty for non-private meetings?  This is the document property that CalSync checks to determine if a meeting is marked as private.  Perhaps your Lotus Notes environment is using a different document property.

     
  • Alain
    Alain
    2010-11-30

    Hi
    I Have the same issue using latest version of CalSync
    I'm using Lotus Notes V7.02 French version
    The "OrgConfidential" property changes under the " Data Length" field, which is set to "1" when the entry is set to private.

     
  • Alain
    Alain
    2010-11-30

    To be more precise, I have 45 entries within 2 weeks range.
    CalSync only finds 16 entries!
    Weird!

    I could not use v1.6 because of a Proxy issue which doesn't exist on V1.7
    Bye, and thanks for working on this program anyway

     
  • Tim McIntyre
    Tim McIntyre
    2010-12-01

    Hi Lidsinker,

    Yes, the Lotus Notes "OrgConfidential" property changes from 1 to a 0, but the event is still added to Google regardless of what setting is set in the privacy tab…

    I have been using V1.6 since I found this problem, and it is functioning fine.
    Privacy settings are mirrored in Google.

    When I upgrade to V1.7 it deletes a whole bunch of events, BUT does still mirror the privacy settings correctly (to the events that weren't deleted…)
    I have played around with the date range to no effect.

    It is weird as it will keep some events, but delete others.
    Example, I created two events, identical, 1 on Monday and 1 on Tuesday…
    CalSync only found and synced the Tuesday event.

    Hope this feedback helps :)

    Let me know what else I can help check for you…

    Cheers

     
  • Tim McIntyre
    Tim McIntyre
    2010-12-01

    Sorry, should look like this….

    Hi Lidsinker, Yes, the Lotus Notes "OrgConfidential" property changes from 1 to a 0. , but the event is still added to Google regardless of what setting is set in the privacy tab…

    I have been using V1.6 since I found this problem, and it is functioning fine. Privacy settings are mirrored in Google.
    When I upgrade to V1.7 it deletes a whole bunch of events, BUT does still mirror the privacy settings correctly (to the events that weren't deleted…)

    I have played around with the date range to no effect. It is weird as it will keep some events, but delete others.
    Example, I created two events, identical, 1 on Monday and 1 on Tuesday…
    CalSync only found and synced the Tuesday event.

    Hope this feedback helps :)
    Let me know what else I can help check for you…

    Cheers

     
  • lidsinker
    lidsinker
    2010-12-01

    I'm a little unclear on the privacy settings.  Is it working correctly or not?  The way it's supposed is that events are synced from LN to Google no matter what.  All the privacy settings do is determine what information gets copied from LN to Google.  A 'low' setting means copy everything.  'Medium' means copy everything unless the meeting is marked as private ("OrgConfidential" equals 1).  If it is private, then the entry is still copied but no information is copied…it only blocks off a time on your calendar.  A 'high' setting means don't copy any information from LN to Google.  It will simply block off time in the Calendar.

    With 1.7 I made some significant changes to how CalSync pulls calendar entries from LN.  It was necessary for folks that have really large mailfiles as their sync times were taking 20-30 minutes.  However, I have seen some problems as you and gorgu112 have detailed.  For some reason, it will not pull certain entries for some users and I'm not sure why.  What I think I will have to do is include the current, faster method and the older, slower method and let users choose the one that works best.  For the life of me I have not been able to figure out the problems with some entries skipped in 1.7.  As best I can tell it's due to differences in the various LN environments.

    You can try and do some troubleshooting with the steps below.

    First, create a file called lntest.vbs.  Put it somewhere that is easy to navigate to like C:\
    Edit the file to include the following code.  Make sure you add your LN password and tweak the dates as needed.  Also, if you are in a location where dates are formatted dd/mm/yyyy then use that date format in your code.

    Dim s
    Set s = CreateObject("Lotus.NotesSession")
    call s.Initialize("password") 'enter your password here
    Set dt = s.CreateDateRange() 'play around with the date format here
    dt.StartDateTime = s.CreateDateTime("10/01/2010") 'Set this date to the first day you want to sync
    dt.EndDateTime = s.CreateDateTime("10/31/2010") 'Set this date to the last day you want to sync
    set dbs = s.GetDbDirectory("")
    Set db = dbs.OpenMailDatabase()
    set v = db.GetView("$Calendar")
    set coll = v.GetAllDocumentsByKey(dt, false)
    wscript.echo "Number of entries found: " & coll.Count
    

    Once you have edited the .vbs file, save it.
    Open a cmd prompt and navigate to where you have saved the .vbs file.  Run the following command.

    cscript lntest.vbs
    

    The result of the script is that it should output how many entries were found.  Perhaps with this you might be able to identify reasons why certain entries are not synced.  This is very hard for me to troubleshoot as I personally have not been able to replicated it.  I know it is a problem, however, as multiple users are reporting this issue.

     
  • Alain
    Alain
    2010-12-01

    Interesting.
    The result of this script shows the exact number of entries from Lotus : 32, while only 16 were synced.

     
  • lidsinker
    lidsinker
    2010-12-01

    Can you run the test script for just one day? Run it on a day that has an entry that you know is not synced.  If that entry still shows up in the count from the vbs script, can you give me the values for the following document properties?

    Form
    StartDateTime
    AppointmentType
    EndDateTime
    OrgConfidential

     
  • Tim McIntyre
    Tim McIntyre
    2010-12-02

    Hi Lidsinker,

    YES, the privacy settings are working correctly in both versions.
    Sorry for the confusion (busy day yesterday)…

    Cheers

     
  • Tim McIntyre
    Tim McIntyre
    2010-12-02

    Hi Lidsinker,

    Your vbs code find 11 entries, between these dates "02/12/2010" & "04/12/2010"
    V1.7 only finds 2 entries, between "02/12/2010" & "04/12/2010"

    copied from Clasync;

    12-02-2010 02:07:17.399  Running CalSync 1.7.1545
    12-02-2010 02:07:17.493  Retrieving Calendar Entries for Lotus
    12-02-2010 02:07:17.493  Retrieving Notes Calendar Entries
    12-02-2010 02:07:17.508  Searching for documents in 'Calendar' view from 12/02/10 to 12/04/10
    12-02-2010 02:07:17.524  Found 2 Notes Calendar entries between 2010-12-02 and 2010-12-04
    12-02-2010 02:07:18.071  Found 2 Google Calendar entries between 2010-12-02 and 2010-12-05
    12-02-2010 02:07:18.087  Creating: 0
    12-02-2010 02:07:18.087  Updating: 0
    12-02-2010 02:07:18.102  Deleting: 0
    12-02-2010 02:07:18.102  Sync Completed!

    I created 3 events (Meeting, Appointment & Reminder) and none were synced…
    Only events that were created by me many weeks ago, and "repeated" weekly, were synced.

    Check out the bold line above, could the date range be jumping / searching incorrectly due to time zone differences?
    I have my LN set to GMT +8:00, then same is set in Google…

    Cheers

     
  • Tim McIntyre
    Tim McIntyre
    2010-12-02

    Extra details for the three events that I added, but CalSync did not sync;

    ~ Meeting ~
    Form "Appointment"
    StartDateTime 04/12/2010 09:00:00 AM ZE8
    AppointmentType "3"
    EndDateTime 04/12/2010 10:00:00 AM ZE8
    OrgConfidential ""

    ~ Appointment ~
    Form "Appointment"
    StartDateTime 04/12/2010 09:00:00 AM ZE8
    AppointmentType "0"
    EndDateTime 04/12/2010 11:00:00 AM ZE8
    OrgConfidential ""

    ~ Reminder ~
    Form "Appointment"
    StartDateTime 04/12/2010 09:00:00 AM ZE8
    AppointmentType "4"
    EndDateTime 04/12/2010 10:00:00 AM ZE8
    OrgConfidential ""

    My StartTimeZone = "Z=-8$DO=0$ZX=25$ZN=China"

    Cheers

     
  • Alain
    Alain
    2010-12-02

    Sorry data in french

    Synced Entry
    Form :
    Nom du champ : Form
    Type de données : Texte
    Longueur des données : 11 octets
    Numéro d'ordre : 1
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    "Appointment"

    Appointment type

    Nom du champ : AppointmentType
    Type de données : Texte
    Longueur des données : 1 octets
    Numéro d'ordre : 1
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    "3"

    Startdate time
    Nom du champ : StartDateTime
    Type de données : Temps
    Longueur des données : 8 octets
    Numéro d'ordre : 5
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    03/12/2010 08:00:00 CET

    Endate time
    Nom du champ : EndDateTime
    Type de données : Temps
    Longueur des données : 8 octets
    Numéro d'ordre : 5
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    03/12/2010 17:00:00 CET

    Orgconfidential
    Nom du champ : OrgConfidential
    Type de données : Texte
    Longueur des données : 0 octets
    Numéro d'ordre : 1
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    ""

    Not Synced Entry
    Form :
    Nom du champ : Form
    Type de données : Texte
    Longueur des données : 11 octets
    Numéro d'ordre : 1
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    Startdate time
    Nom du champ : StartDateTime
    Type de données : Temps
    Longueur des données : 8 octets
    Numéro d'ordre : 1
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    03/12/2010 08:30:00 CET

    Appointment Type
    Nom du champ : Form
    Type de données : Texte
    Longueur des données : 11 octets
    Numéro d'ordre : 1
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    "Appointment"

    Endate time
    Nom du champ : EndDateTime
    Type de données : Temps
    Longueur des données : 8 octets
    Numéro d'ordre : 1
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    03/12/2010 16:00:00 CET

    Orgconfidential
    Nom du champ : OrgConfidential
    Type de données : Texte
    Longueur des données : 0 octets
    Numéro d'ordre : 1
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    ""

     
  • Alain
    Alain
    2010-12-02

    The only difference I see is for the field "Numéro d'ordre" which is 1 to each property when synced, and 5 when not for startdate time and endate time field only.
    This field means "number of order"

     
  • Tim McIntyre
    Tim McIntyre
    2010-12-02

    The "Numéro d'ordre" is the "Seq Num:" in ENGLISG version of lotus notes ( I think…)

    But, I have searched a few entries, and have found anything from 1 to 16 as this number.
    It seems as though this is not the problem, as I have found a "1" to sync, and also not to sync… :(

    Again, only startdatetime and enddatetime properties.

     
  • Alain
    Alain
    2010-12-02

    Is there anyway to extract (xls or txt or…)all properties from an entry?

     
  • lidsinker
    lidsinker
    2010-12-02

    I don't think there is a way to extract the properties as xls or txt.  I'll look into it some more.

    Can each of you try version 1.7 that is archived in the "Previous Releases" folder.  It did something with dates a bit differently and I wonder if it will work for you.  As far as I can tell this is an issue with date formatting.

     
  • Alain
    Alain
    2010-12-02

    I have just tried the version you proposed, but the entries found are exactly the same as for V1.7.1545, that means not all.

     
  • Alain
    Alain
    2010-12-02

    I have just selected in the check box 'show verbose log", and interesting, the number of entrie 63 is correct (same as lntest.vbs)
    but only 24 are synced
    What is "Verbose"?

    12-02-2010 07:59:34.397  Running CalSync 1.7.1545
    12-02-2010 07:59:34.407  Logging in to Google Calendar
    12-02-2010 07:59:34.537  Logging in to Lotus Notes
    12-02-2010 07:59:34.537   Domino.NotesSession Created
    12-02-2010 07:59:34.537   NotesSession initialized
    12-02-2010 07:59:34.537   Servername and mailfile are null
    12-02-2010 07:59:34.537   Mail database found
    12-02-2010 07:59:34.537   LoggedIn = true
    12-02-2010 07:59:34.537   First login
    12-02-2010 07:59:34.537  Successfully logged into Notes!
    12-02-2010 07:59:45.112  Successfully logged into Google!
    12-02-2010 07:59:45.112  Retrieving List of Google Calendars
    12-02-2010 07:59:45.112  Google Calendars Retrieved
    12-02-2010 07:59:45.122  Default calendar set: Principal
    12-02-2010 07:59:45.122  Ready to Sync!
    12-02-2010 08:00:47.034  Running CalSync 1.7.1545
    12-02-2010 08:00:47.054  Retrieving Calendar Entries for Principal
    12-02-2010 08:00:47.064  Retrieving Notes Calendar Entries
    12-02-2010 08:00:47.074  Searching for documents in 'Calendar' view from 11/25/10 to 02/02/11
    12-02-2010 08:00:47.084   Found 'Calendar' view. Searching through 63 calendar entries.
    12-02-2010 08:00:47.084   Finished searching 0 entries.
    12-02-2010 08:00:47.154   Finished searching 63 entries.
    12-02-2010 08:00:47.154  Found 24 Notes Calendar entries between 2010-11-25 and 2011-02-02
    12-02-2010 08:01:01.475  Found 0 Google Calendar entries between 2010-11-25 and 2011-02-03
    12-02-2010 08:01:01.475   Google Calendar entries retrieved
    12-02-2010 08:01:01.515  Creating: 24
    12-02-2010 08:01:01.515  Updating: 0
    12-02-2010 08:01:01.515  Deleting: 0
    12-02-2010 08:01:01.525  Processing 24 calendar updates on Google Calendar.
    12-02-2010 08:02:11.479  All batch operations successful!
    12-02-2010 08:02:11.479  Sync Completed!

     
  • lidsinker
    lidsinker
    2010-12-02

    Aha!  That was what I needed.  I know what the problem is now.  The problem isn't with Notes as it's pulling in all the correct entries.  The problem is that before I sync the information to Google I double check the data and verify that it is in the sync window.  The problem is that my code isn't correctly converting the date strings from the StartDateTime property.  My code is using mm/dd/yyyy instead of dd/mm/yyyy.

    I know what the problem is now and I'll release an updated version tomorrow.  I'll post back here once released.

    As for VERBOSE, it simply means those are log entries that are hidden unless the "Show Verbose Log" box is checked.

     
  • lidsinker
    lidsinker
    2010-12-03

    For those of you having problems, could you please check the following information for me?

    Please look in your Regional and Language Options control panel and tell me what country is setup there.  Also, please post the value in the "Short date:" field.  I know what it is in the code that's causing the problems but I'm trying to figure out why exactly it's not detecting the correct date format to use.  I'm wondering if the date formats that Lotus Notes uses are different from the date formats that your systems are using.

     
  • Alain
    Alain
    2010-12-03

    Settings in French, Local time GMT+1
    I have made 2 screen copies with international settings, I could send you

    2 Fields with region settings (I checked they are the same whether the entry is synced or not)
    Nom du champ : StartTimeZone
    Type de données : Texte
    Longueur des données : 44 octets
    Numéro d'ordre : 1
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    "Z=-1$DO=1$DL=3 -1 1 10 -1 1$ZX=51$ZN=Romance"

    Nom du champ : EndTimeZone
    Type de données : Texte
    Longueur des données : 44 octets
    Numéro d'ordre : 1
    ID d'élément en double : 0
    Indicateurs de champ : SUMMARY

    "Z=-1$DO=1$DL=3 -1 1 10 -1 1$ZX=51$ZN=Romance"

     
  • lidsinker
    lidsinker
    2010-12-03

    Can you check the Short date format in the Regional and Language Control Panel for your operating system?  CalSync is supposed to detect the date/time format that your OS is using and then use that format to convert the date/time string from Lotus Notes into a Date object.

     
  • Alain
    Alain
    2010-12-03

    Short Date Format : jj/MM/aaa
    date separator : /

    Exemple : 03/12/2010

     
  • lidsinker
    lidsinker
    2010-12-03

    OK, try this exe I just uploaded in the test releases.  Run it from the same folder as your existing CalSync.exe.  After you run a sync, check the verbose log box and upload the log results here.

    Download Link

     
1 2 > >> (Page 1 of 2)