#4 only fetch unread messages w/o id file

closed
None
1
2007-06-19
2007-05-24
pss7
No

gotmail had a mature parameter called "---only-new
Only previously unread messages will be retrieved."

I love this feature since it makes the need of an ID file completly unnecessary :-)

Discussion

  • Jos De Laender

    Jos De Laender - 2007-05-24

    Logged In: YES
    user_id=242946
    Originator: NO

    I have to give this one a thought ...

    I know the option in gotmail (coming from there ;)) but it tends to work against me in the case that I want to replicate the hotmail account to my pc, but I'm also reading every now and then via the web interface.

    If I have the cron job reading --only-new it misses the messages that I read before via the web.

    Therefore I inspired myself more on the way pop3 clients are working : keeping track of the downloaded messages in a local database.

    When you use this consistently, you never miss messages and you never download too much, independent from peeking in parallel via the web or not. Even if you replicate to more than one pc, this still works.

    That's why I explicitly choose for the ID file.

    What are the arguments *against* it ? It doesn't seem a big issue to me to specify this ID file in the config file ?

    Jos

     
  • Jos De Laender

    Jos De Laender - 2007-05-24
    • priority: 5 --> 1
     
  • pss7

    pss7 - 2007-05-24

    Logged In: YES
    user_id=1800513
    Originator: YES

    I tried to use one id file (hardcoded within the perl script) for 189 hotmail accounts (only 1938 messages), till now (4h) it seems to work, the destination mailbox size and email count is right (equal).

    I understand yout point of view, but one other user scenario might be only getting mails which no one has read before.

    this feature is sure not a must have, but practically - since it would offer the user more flexibility :-)

     
  • Nobody/Anonymous

    Logged In: NO

    Thanks for the great app!

    It took way too long to check all the messages when using the id file, while the only-new option makes gotmail run much faster.

     
  • Jos De Laender

    Jos De Laender - 2007-05-27

    Logged In: YES
    user_id=242946
    Originator: NO

    Dear,

    Can you try to be a bit more precise ?

    Do I read this as : it took way too long to check the messages the first time ?
    (i.e. when it has to download everything ?)

    If you mean that it takes way too long all the time, what times do you mean then ? How many messages ?
    (Currently the file is searched in a naive unsorted lookup, obviously changing this to a hash would dramatically improve speed, but not for the first time fetch).

    Having said that, to keep everybody happy, I might have indeed found a way to implement also only-new in a consistent language independent way over the old hotmail and the live hotmail. Stay tuned.

    Jos

     
  • Nobody/Anonymous

    Logged In: NO

    Dear Jos,

    I just tried twice and both take long time to go through all the messages (total 500+). Thanks!

    ilmw

     
  • Jos De Laender

    Jos De Laender - 2007-05-28

    Logged In: YES
    user_id=242946
    Originator: NO

    Dear,

    That's surprising me. I've handled larger boxes. And swallowing 500 lines in perl is faster than curl calls. Can you try to help me a bit ?

    - Can I ask to check roughly where the beast is spending its time ? You might want to run it with --verbosity 2 (or even 10) for that reason.

    - Do you observe that the messages that were previously fetched are not fetched anymore ? (not thrown through procmail or whatever filter you use)

    - Are you're expectations correct ? I mean, fetching a lot of stuff via curl calls is slow by nature (it's simulated browsing after all).

    - Is it handled really faster by gotmail ? I have to dig into that one , but I believe that a difference might be that GetLive is fetching all the Inbox pages completely (to get all the message id's) and then deciding whether or not to fetch the underlying message. gotmail might stop fetching Inbox pages as soon it saw a message read, assuming that all the remainder is read. If so, that's a shaky assumption. I would not take it and if speed gain is reached from that, you wouldn't see it in my --only-new-messages implementation.

    Thx for your feedback,

    Jos

     
  • Nobody/Anonymous

    Logged In: NO

    Dear Jos,

    I tried again tonight then I figured out that it worked as expected. Much faster this time and it only fetched the unfetched messages.

    gotmail works correctly on the "unread message" feature as well per my checking.

    Thanks a lot!

    ilmw

     
  • Jos De Laender

    Jos De Laender - 2007-05-28

    Logged In: YES
    user_id=242946
    Originator: NO

    Dear,

    Ok, this way the things make sense again and my --only-new-messages is only a matter of finding a reliable equivalent in the Hotmail Live boxes.

    I read the gotmail code once more on that specific part and it should indeed work correctly. Apparently I did patch it in the past already there.

    You would agree that the presence of --only-new-messages functionlaity is exclusive to the Downloaded= option.
    I.e. both options cannot be present at the same time ?

    Jos

     
  • Jos De Laender

    Jos De Laender - 2007-05-28
    • assigned_to: nobody --> jdla
     
  • Jos De Laender

    Jos De Laender - 2007-06-19

    Logged In: YES
    user_id=242946
    Originator: NO

    Solved in revision 1.22 (Release_0_7).

     
  • Jos De Laender

    Jos De Laender - 2007-06-19
    • status: open --> closed
     

Get latest updates about Open Source Projects, Conferences and News.

Sign up for the SourceForge newsletter:





No, thanks