Hotmail changing again (January 2014)

Help
s.j.
2014-01-27
2014-06-05
1 2 > >> (Page 1 of 2)
  • s.j.
    s.j.
    2014-01-27

    It appears that Hotmail's structure is changing again.

    I'm getting the standard "Could not log in. Maybe structure has changed or was not foreseen." message, using the latest version from CVS.

    I think the difference is that there are now short tips at the bottom of current mail folder like: "To send and receive email from your other account in Outlook.com, add your other account as Send-only, then sign in to the other account and set up mail forwarding."

    This change started about a week ago, and has persisted ever since.

    Thanks

     
  • Jos De Laender
    Jos De Laender
    2014-01-27

    As soon as I have an account that shows the behaviour you mention, I will try and fix.
    Unluckily, for the moment, none of my accounts is having any problems.

    Are you sure nothing else has changed ? (an intermediate validation screen, or something else around your login ?)

    You might want to go once more through the process via the webinterface, preferably using mozilla firefox.

    Js

     
  • s.j.
    s.j.
    2014-01-27

    Yes, I logged in using Firefox as soon as the errors started.

    It was working for quite some time, then suddenly stopped working last week, and I have not been able to successfully retrieve messages since then. There were no intermediate validation screens to add a phone number or anything like that.

    The interface looks exactly the same except for a little tip-of-the-day panel at the bottom of the messages of the currently displayed folder. They are not the same every time, although I am puzzled by the specific message I quoted above.

    Thanks

     
  • Jos De Laender
    Jos De Laender
    2014-01-27

    Dear,

    Without having a test case it's difficult finding out what the problem is.
    The message you get, still points more to a login problem.

    Do you have any perl skills ?

    If so, have look to line 564 and next few ones. There you see how a login is validated.
    You could try and print out LoginPageAsString and figure out what goes wrong exactly.

    Jos

     
    • s.j.
      s.j.
      2014-02-24

      Hi,

      My perl skills are pretty basic.

      I did some verbose debugging and some diffs of the results. My results were in accordance with what Lawrence Chen reported, but I haven't been able to really look at this much more in depth.

      Just an fyi, this problem seems to be slowly propagating this past week.

      Thanks

       
      • Jos De Laender
        Jos De Laender
        2014-02-24

        I would be happy to assist but even till now I don't have a single account that fails. So no material to debug upon.

        Given that (i.e. that it seems to be propagating so different than previous changes) I am still wondering if there's no unintentional user interaction that brings the account in a certain state.

         
        • s.j.
          s.j.
          2014-02-24

          The accounts that are affected, as far as I can tell, have that same message: "To send and receive email from your other account in Outlook.com, add your other account as Send-only, then sign in to the other account and set up mail forwarding."

          But I am able to log in without any intermediate verificatoin steps.

          Is Lawrence seeing this as well?

          I'm not doing anything else but using GetLive, and fetchmail is periodically checking mail as a fallback.

           
        • Lawrence Chen
          Lawrence Chen
          2014-02-24

          I've been distracted by other things, so haven't looked further.

          Right now its still one account works and one account doesn't work. GetLive is pretty much the only interaction I have with the accounts.

          Not sure if its important, but the account that isn't working was one where I had locked in the 25GB of initial skydrive storage, while I missed out with the other account....

           
  • Lawrence Chen
    Lawrence Chen
    2014-02-03

    This is happening to one of my accounts as well (appears to have started January 21st, getlive.down timestamp is January 20th and I have a new message dated January 22nd -- from "The Outlook.com Team").

    Printing out $LoginPageAsString, the thing that stands out is:

        <head>
            <title >Outlook.com&#58; Inbox</title>
            <meta name="MobileOptimized" content="0"/><meta name="viewport" content="width&#61;device-width&#59; initial-scale&#61;1.0&#59; maximum-scale&#61;1.0&#59;"/>
            <style type="text/css" ></style>
            <link href="https://a.gfx.ms/WideMobile_mobile_kNOTcHZdNU27ZpJLMWW9UQ2.css" rel="Stylesheet" type="text/css" />
    

    But when I connect with my browser (chrome with User-Agent switcher set to same string that GetLive is using), I get lots more stuff in head, and title is:

    <title>Outlook.com - thedreamer68&#64;hotmail.com</title>
    

    Where it appears to be looking for "Outlook - thedreamer68@hotmail.com"...

    The Dreamer

     
    Last edit: Lawrence Chen 2014-02-03
  • Jos De Laender
    Jos De Laender
    2014-02-03

    Dear,

    At this moment, I still don't have any account that reflects the issue, so I need to rely on your info.

    It looks like the login procedure is not working anymore on such accounts. Anything special about this account compared to the ones that still do work ?

    Can I safely assume it is not just the title problem, i.e. if you suppress in GetLive the "safety check" on title, it still does not work ? (it should be very easy to locate that piece of code).

    Jos

     
    • s.j.
      s.j.
      2014-03-26

      It appears that newly-created accounts are now affected.

       
      • Jos De Laender
        Jos De Laender
        2014-03-26

        In a certain sense that would be good news ! I can make a testcase then.
        The bad news ... : I'm very short of time coming days/weeks. But as soon as I can, I will have a look !
        Jos

         
        • Jos De Laender
          Jos De Laender
          2014-04-08

          Dear all,

          I did have an hour or so a look into the problem. It looks not too simple.
          I could login via the script , until the inbox, using the user agent found on my Windows firefox.

          Some rather trivial changes are needed along the lines of fppCfg now is called "fppConfig" (with the quotes) and still some stuff like that.

          (You can find that relatively easily by running with Verbosity 100 and inspecting the log files in a text browser, copying the html pages out of the log file into another file and reading that in the browser).

          But then I'm stuck ... My previous folder tree reading and browsing doesn't work.

          Someone who can reach a helping hand with above info ?

          Who's still interested anyway ? An alternative might be to read all of the structure from the mobile site, collecting also the msgids and then reading the messsage ids from the live site. Maybe I could do that as a quick hack for myself, but then I'd maybe do it in Python.

          Anyone thoughts, help, ... ?

          Jos

           
          • s.j.
            s.j.
            2014-04-11

            Have you had a chance to look at the mobile site yet? That thought had occurred to me as well.

             
            • Jos De Laender
              Jos De Laender
              2014-04-11

              That would be reasonably simple. The big issue however is that the mobile site has no possibility - as far as I know - to download the bare source of the message, which is where I rely on ...

               
          • s.j.
            s.j.
            2014-04-12

            Looking at the mobile site to get the mids seems like a great workaround, but how do you map the mid (from the mobile site) to the tid (on the desktop site)? fid has to be mapped, too. Do you think this would be a good long-term solution?

             
            • Jos De Laender
              Jos De Laender
              2014-04-12

              Assuming that the mid is sufficient to fetch an e-mail (and up to now it was) there wouldn't be a need to do anything else on the 'full' site. All moving, deleting etc. could be done easier on the mobile site.

              I need to find some time to find out if this is really doable.
              As it would be a major rewrite, I was wondering if Python is an option ? Nowadays I'm more into that language.

               
              • s.j.
                s.j.
                2014-04-12

                Python would be great, actually.

                 
  • Lawrence Chen
    Lawrence Chen
    2014-02-03

    Appears the problem is it going to the "MobileOptimized" page when using a browser doesn't.

    Doing some digging around it appears that the comment about "I'm afraid that the need for an embedded JS interpreter is coming closer ..." is likely the problem. Would guess the response is making it go the the MobileOptimized page which has no JavaScript.

    The BrowserSupport page warns that the Mobile page is limited...which suggests something before that has made the decision for us.

    I looked at the page before the comment, and I can't even begin to figure out what the next step should be.

    My Perl might be a bit rusty (though I am reworking some scripts at work right now), and it has been a while since I've done scripts that scrape web pages, etc. Guess the last time was last April, did a Perl script to scrape navigate and scrape information pages in new DSL modem to feed cacti.

    But, digging further...it actually appears that the BrowserSupport page has JavaScript that checks if you are a Mobile device or not...

    But, can't see where it rewrites the page to non-Mobile device, etc. So, it could still be something before it gets to this page that has decided we a Mobile Device.

    Though from what I can tell, its just looking to see if "Mobile", "Tablet", "Handheld", "Android", "iPhone", "Kindle", "Silk", "Nokia", "Symbian", "Blackberry" appear in the UserAgent string....so its probably before it gets to this page that it has decided we're Mobile....

    Tried forcing it back to 'http://www.hotmail.com' every time it got mobile...eventually (before reaching MaxCycles) threw me to 'https://login.live.com/jsDisabled.srf' So, there's something JavaScript that's needed to make it not be Mobile...

    The Dreamer
    The Dreamer

     
    • Jos De Laender
      Jos De Laender
      2014-02-03

      Don't scare me :)

      While all this might be true, I still would like to understand why some
      accounts do have the problems and others not. It might be a phased roll-out
      issue (damned !) or something might be special about the failing accounts.
      No clues in that direction ?

      Jos

      2014-02-03 Lawrence Chen thedreamer@users.sf.net:

      Appears the problem is it going to the "MobileOptimized" page when using a
      browser doesn't.

      Doing some digging around it appears that the comment about "I'm afraid
      that the need for an embedded JS interpreter is coming closer ..." is
      likely the problem. Would guess the response is making it go the the
      MobileOptimized page which has no JavaScript.

      The BrowserSupport page warns that the Mobile page is limited...which
      suggests something before that has made the decision for us.

      I looked at the page before the comment, and I can't even begin to figure
      out what the next step should be.

      My Perl might be a bit rusty (though I am reworking some scripts at work
      right now), and it has been a while since I've done scripts that scrape web
      pages, etc. Guess the last time was last April, did a Perl script to scrape
      navigate and scrape information pages in new DSL modem to feed cacti.

      But, digging further...it actually appears that the BrowserSupport page
      has JavaScript that checks if you are a Mobile device or not...

      But, can't see where it rewrites the page to non-Mobile device, etc. So,
      it could still be something before it gets to this page that has decided we
      a Mobile Device.

      Though from what I can tell, its just looking to see if "Mobile",
      "Tablet", "Handheld", "Android", "iPhone", "Kindle", "Silk", "Nokia",
      "Symbian", "Blackberry" appear in the UserAgent string....so its probably
      before it gets to this page that it has decided we're Mobile....

      Tried forcing it back to 'http://www.hotmail.com' every time it got
      mobile...eventually (before reaching MaxCycles) threw me to '
      https://login.live.com/jsDisabled.srf' So, there's something JavaScript
      that's needed to make it not be Mobile...

      The Dreamer
      The Dreamer


      Hotmail changing again (January 2014)https://sourceforge.net/p/getlive/discussion/686670/thread/dd83d9fd/?limit=25#b191

      Sent from sourceforge.net because you indicated interest in
      https://sourceforge.net/p/getlive/discussion/686670/

      To unsubscribe from further messages, please visit
      https://sourceforge.net/auth/subscriptions/

       
      Attachments
  • Lawrence Chen
    Lawrence Chen
    2014-02-04

    The account that works:

    MSNSERVER: H: SNT146-W8 V: 17.1.7317.6000 D: 2014-01-17T10:26:16

    The account that doesn't work:

    MSNSERVER: H: COL125-W49 V: 17.2.7323.6000 D: 2014-01-23T10:44:40

    Yeah, looks like a roll out that has reached everybody yet.

    The other more obvious difference is its "Outlook" in the title of the working account and its "Outlook.com" in the title for the not working account.

    The Dreamer

     
    Last edit: Lawrence Chen 2014-02-04
  • Lawrence Chen
    Lawrence Chen
    2014-02-04

    Got a little bit further...changed UserAgent String to Firefox 15 (highest built-in in user agent switcher extension that I'm using)....also changed the LoggedIn check to be:

      $Title =~ s/Outlook\.com - //;
      if ($Title =~ m/^$Login&#64;$Domain$/i) {
    

    But then it dies with "Could not retrieve 'fppCfg'."

    So, I notice there's fppConfig... so the line becomes:

       if ($LoginPageAsString !~ m/"fppConfig":\s*?\{(.*?)\}/s) {
    

    and then

       if ($FppCfg !~ m/"SessionId":\s*?"(.*?)",/s) {
    

    and then

       if ($FppCfg !~ m/"AuthUser":\s*?"(.*?)",/s) {
    

    And, then its stuck with "Could not detect 'folderViewModel'." Which I have no idea what it might be called in the new page, and nothing seems to resemble it.

    The Dreamer

     
    Last edit: Lawrence Chen 2014-02-04
  • Lawrence Chen
    Lawrence Chen
    2014-03-12

    So nobody else looking?

    Took a moment to look again....at where I had left off....

    The current stop point is "Could not detect 'folderViewModel'"

    Looking at what it got...the closest that I can find to this was:

    ol.initialData = function () {
      return [new HM.ItemListData(0, null, {}, {}, [], new HM.MessageGroupQuery(
            null, null, 4, 5, false, 2, null, 1, nul l, 7, null,
            null, 0, 1, 4, false, null, 0, null, 1), true, true,
        0, "2014-03-11T23\x3a01\x3a55.401Z", false), new HM.ItemListData(
        0, null, {
            "cmgAVaabmD4xGVywAjfeM0hg2": new HM.RollupData(new HM
                .Rollup("cmgAVaabmD4xGVywAjfeM0hg2", null, null,
                    1, 1, "2014-01-22T23\x3a03\x3a35.177Z",
                    "\x3cspan email\x3d\x22outlook\x26\x2364\x3bemail.microsoft.com\x22\x3eThe Outlook.com Team\x3c\x2fspan\x3e", [
                        new HM.SenderDetails(
                            "The Outlook.com Team", null,
                            "outlook\x40email.microsoft.com",
                            null, null,
                            "00000000-0000-0000-0000-000000000000",
                            null, "0", false, false, null, true,
                            false, null, null, false, false)
                    ], null, "Outlook.com \x2b Twitter, together",
                    "Outlook.com \x26\x2343\x3b Twitter, together",
                    false, 0, false, false, [3, 15], "27 KB",
                    true, 0, ["outlook\x40email.microsoft.com"],
                    false, false, false, false, false, false,
                    false, false, "1\x2f22\x2f14",
                    "Wed 1\x2f22\x2f14 5\x3a03 PM", null,
                    "flinbox", false, "0", "0", "0",
                    "1390431815177"), null, 0, null, 25344,
                "5246946304579157904", 0, 1, 0, 0, 7),
            "cmU1DTnp-a4xGAhQAjfeN40g2": new HM.RollupData(new HM
                .Rollup("cmU1DTnp-a4xGAhQAjfeN40g2", null, null,
                    1, 1, "2014-02-21T02\x3a26\x3a57.177Z",
                    "\x3cspan email\x3d\x22microsoft\x26\x2364\x3bemail.microsoft.com\x22\x3eMicrosoft\x3c\x2fspan\x3e", [
                        new HM.SenderDetails("Microsoft", null,
                            "microsoft\x40email.microsoft.com",
                            null, null,
                            "00000000-0000-0000-0000-000000000000",
                            null, "0", false, false, null, true,
                            false, null,
                            null, false, false)
                    ], null, "Welcome to OneDrive",
                    "Welcome to OneDrive", false, 0, false, false, [
                        3
                    ], "31 KB", true, 0, [
                        "microsoft\x40email.microsoft.com"
                    ], false, false, false, false, false, false,
                    false, false, "2\x2f20\x2f14",
                    "Thu 2\x2f20\x2f14 8\x3a26 PM", null,
                    "flinbox", false, "0",
                    "0", "0", "1392949617177"), null, 0, null,
                25344, "5246971482599157904", 0, 1, 0, 0, 7),
            "cmE-C8XpOh4xGuqwAjfeQX6A2": new HM.RollupData(new HM
                .Rollup("cmE-C8XpOh4xGuqwAjfeQX6A2", null, null,
                    1, 1, "2014-03-01T22\x3a46\x3a54.710Z",
                    "\x3cspan email\x3d\x22onedrive\x26\x2364\x3bemail.microsoft.com\x22\x3eOneDrive\x3c\x2fspan\x3e", [
                        new HM.SenderDetails("OneDrive", null,
                            "onedrive\x40email.microsoft.com",
                            null, null,
                            "00000000-0000-0000-0000-000000000000",
                            null, "0", false, false, null, true,
                            false, null, null, false, false)
                    ], null, "Getting started is easy",
                    "Getting started is easy", false, 0, false,
                    false, [3, 15], "26 KB", true, 0, [
                        "onedrive\x40email.microsoft.com"
                    ], false, false, false, false, false, fals e,
                    false, false, "3\x2f01\x2f14",
                    "Sat 3\x2f01\x2f14 4\x3a46 PM", null,
                    "flinbox", false, "0", "0", "0",
                    "1393714014710"), null, 0, null, 25344,
                "5246979126574487904", 0, 1, 0, 0, 7)
        }, {}, ["cmE-C8XpOh4xGuqwAjfeQX6A2",
            "cmU1DTnp-a4xGAhQAjfeN40g2",
            "cmgAVaabmD4xGVywAjfeM0hg2"
        ], new HM.Messa geGroupQuery(null, null, 4, 40, false, 2,
            null, 0, "flinbox", null, null, 7, 0, 1, 4, true,
            null, 1, null, 1), true, true, 3,
        "2014-03-11T23\x3a01\x3a55.401Z", false), new HM.ContainerPoolData(
        5, 0, {
            "fljunk": new HM.ContainerData(new HM.Folder("fljunk",
                "flAAAAAAAAAAAAAAAAAAAAAA2", 0, 1, 3,
                "53277", false, false, false, 0, 0, null,
                "Junk", 3)),
            "fldrafts": new HM.ContainerData(new HM.Folder(
                "fldrafts", "flAAAAAAAAAAAAAAAAAAAAAA2", 0, 1,
                0, "0", false, false, false, 0, 0, null,
                "Drafts", 0)),
            "flsent": new HM.ContainerData(new HM.Folder("flsent",
                "flAAAAAAAAAAAAAAAAAAAAAA2", 0, 1, 0,
                "0", false, false, false, 0, 0, null, "Sent",
                0)),
            "fltrash": new HM.ContainerData(new HM.Folder(
                "fltrash", "flAAAAAAAAAAAAAAAAAAAAAA2", 0, 1,
                0, "0", false, false, false, 0, 0, null,
                "Deleted", 0)),
            "flinbox": new HM.ContainerData(new HM.Folder(
                "flinbox", "flAAAAAAAAAAAAAAAAAAAAAA2", 0, 1,
                3, "85524", false, false, false, 0, 0, null,
                "Inbox", 3))
        }, ["flinbox", "fljunk", "fldrafts", "flsent", "fltrash"]
    ), new HM.FoldersHashWrapper(25, "L3SZUw2"), new HM.ContainerPoolData(
        5, 1, {
            "73": new HM.ContainerData(new HM.Category(73, 0,
                "0000ff", 0, 97, 1, null, "Documents", 0)),
            "69": new
            HM.ContainerData(new HM.Category(69, 0, null, 0, 36,
                1, null, "Shipping updates", 0)),
            "-1": new HM.ContainerData(new HM.Category(-1, 2,
                null, 0,
                32, 1, null, "Everything else", 0)),
            "67": new HM.ContainerData(new HM.Category(67, 2,
                null, 0, 44, 1, null, "Groups", 0)),
            "65": new HM.ContainerDa
            ta(new HM.Category(65, 0, "0000ff", 0, 32, 1, null,
                "", 0)),
            "63": new HM.ContainerData(new HM.Category(63, 0,
                "0000ff", 0, 37, 1, null, "Documents",
                0)),
            "61": new HM.ContainerData(new HM.Category(61, 0,
                null, 0, 96, 1, null, "Videos", 0)),
            "85": new HM.ContainerData(new HM.Category(85, 0,
                null, 0, 52, 1, null, "Travel", 0)),
            "83": new HM.ContainerData(new HM.Category(83, 0,
                null, 0, 52, 1, null, "Shopping", 0)),
            "11": new HM.ContainerData(n ew HM.Category(11, 0,
                null, 0, 96, 1, null, "Other replies", 0)),
            "55": new HM.ContainerData(new HM.Category(55, 2,
                null, 0, 44, 1, null, "Social updates", 0)),
            "15": new HM.ContainerData(new HM.Category(15, 2,
                "0000ff", 2, 45, 1, null, "Newsletters", 2)),
            "53": new HM.ContainerData(new HM.Cat egory(53, 0,
                "0000ff", 0, 37, 1, null, "Photos", 0)),
            "81": new HM.ContainerData(new HM.Category(81, 0,
                null, 0, 52, 1, null, "Bills", 0)),
            "75": new HM
                .ContainerData(new HM.Category(75, 0, null, 0, 52,
                    1, null, "Important", 0)),
            "77": new HM.ContainerData(new HM.Category(77, 0,
                null, 0, 52, 1, null, "Family", 0)),
            "9": new HM.ContainerData(new HM.Category(9, 0,
                "0000ff", 0, 32, 1, null, "", 0)),
            "7": new HM.ContainerData(new HM.Category(7, 0,
                "0000ff", 0, 33, 1, null, "Flagged", 0)),
            "5": new HM.ContainerData(new HM.Category(5, 2,
                "0000ff", 0, 33, 1, null, "Contacts", 0)),
            "3": new HM.Conta
            inerData(new HM.Category(3, 0, "0000ff", 3, 32, 1,
                null, "", 3)),
            "1": new HM.ContainerData(new HM.Category(1, 2,
                "0000ff", 3, 33, 1, null, "Unread",
                3)),
            "0": new HM.ContainerData(new HM.Category(0, 2, null,
                0, 32, 1, null, "All", 0))
        }, [0, 1, 65, 3, 9, 81, 5, 73, 63, 77, 7, 67, 75, 15, 11,
            53, 69, 83, 55, 85,
            61, -1
        ])];
    }; ^ M
    
     
    Last edit: Lawrence Chen 2014-03-12
  • Morusec
    Morusec
    2014-04-29

    I have the same problem as above. For weeks.
    Is that project still active? Or any recommendations on an alternative?

    Thank you

     
    • Jos De Laender
      Jos De Laender
      2014-04-29

      I still have the intention to update, but simply have no time for the moment.

      The issue is that the new change in hotmail/outlook is by far not a trivial one to translate into GetLive; it might ask a complete rework.

       
1 2 > >> (Page 1 of 2)