#547 speedup single thread download

future
pending
Fabian Keil
5
2011-12-31
2011-12-25
ilu
No

Some applications(itunes for example) download with one thread, it is very very slow(<50KB/s) sometimes, it will take many hours to download a 100+MB app.

I think while privoxy get a request for a large file, privoxy can fork some threads the prefetch the large file. That should be able to speed up the download.

Is that possible?
Could you please add this feature.

Thank you.

Discussion

  • Fabian Keil
    Fabian Keil
    2011-12-26

    The number of threads doesn't necessarily influence the speed of the download.

    If the server has a per-connection speed limit, it may be possible to work around that by opening multiple connection at the same time (which doesn't require using more that one thread) to request different parts of the downloaded resource in parallel, but it will only work if the server supports range requests.

    Many download managers already support this.

    Modifying Privoxy to do that would certainly be possible and patches are always welcome.

     
  • Fabian Keil
    Fabian Keil
    2011-12-26

    • assigned_to: nobody --> fabiankeil
    • status: open --> pending
     
  • ilu
    ilu
    2011-12-27

    Thank you for your reply.

    Many app store, apple's iTunes store, sony's PSN and etc, can only use they own application to download (I think). So the other managers don't work.

    And these store should have a large group servers, or they use CDN like Akamai. Many server should have the same file.
    I think they should not have the speed limit. But I don't know whether these servers support range requests.

    I think this feature would help to improved the web browsing also. It should be faster.

    Modifying/patch may be too difficult for me:(

     
  • ilu
    ilu
    2011-12-27

    • status: pending --> open
     
  • Fabian Keil
    Fabian Keil
    2011-12-31

    I agree that a feature like this could be useful for some users, but if there's nobody around to implement it, it's unlikely to happen.

     
  • Fabian Keil
    Fabian Keil
    2011-12-31

    • status: open --> pending