recursive download or parallel URLs
Status: Alpha
Brought to you by:
coroberti
From: Pieter L. <pie...@ne...> - 2015-10-29 13:26:28
|
Hi curl-loader enthusiasts, When a browser fetches a URL, it will analyze the content of the returned page and next fetch all embedded objects in parallel. Can curl-loader simulate this behavior? Since I want to use curl-loader in a test environment, I know the page to fetch upfront. That means I can construct a curl-loader config that contains the URLs of all objects, but still I would like to fetch all objects in parallel and not one after the other. Can curl-loader do this? Pieter Lauwers Network Engineer E-mail: pie...@ne... Tel: +32 3 610 8415 (direct) Newtec Laarstraat 5, B-9100 Sint-Niklaas, Belgium Tel: +32 3 780 65 00 (switchboard) / Fax: +32 3 780 65 49 Newtec - *Shaping the Future of Satellite Communications* Secure your future - Meet Newtec Dialog® <http://www.newtec.eu/product/newtec-dialog> - the platform that embraces change. With Mx-DMA™ <http://www.newtec.eu/technology/mx-dma> - Discover the WTA ‘Teleport Technology of the Year’ award winner 2015! ***mail confidentiality footer *** This message and any attachments thereto are confidential. They may also be privileged or otherwise protected by work product immunity or other legal rules. If you have received it by mistake, please let us know by e-mail reply and delete it from your system; you may not copy this message or disclose its contents to anyone. E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore is in no way liable for any errors or omissions in the content of this message, which may arise as a result of e-mail transmission. If verification is required, please request a hard copy. |