Menu

simplifying download of images / usage of aria2

Anselm D
2015-07-07
2015-09-07
  • Anselm D

    Anselm D - 2015-07-07

    To make the download of the images more simple, I used the aria2 command line download manager.

    I put all the urls of all files to download into a file, and called it:
    xowa_image_download_https.txt (this one has windows cr/lf endings, but I was also able to use it at Ubuntu)

    With the following command line, it starts. You can stop it with ctrl-c and can resume it with the same command line. (it will change the xowa_image_download_https.txt files and add resume information)

    aria2c --save-session=xowa_image_download_https.txt --input-file=xowa_image_download_https.txt
    

    At first I had some difficulties with resuming, but the author of aria2 was able to help very fast:

    resume download / using --input-file · Issue #431 · tatsuhiro-t/aria2
    https://github.com/tatsuhiro-t/aria2/issues/431

     

    Last edit: Anselm D 2015-07-07
  • gnosygnu

    gnosygnu - 2015-07-08

    Thanks for the instructions. I know I've stalled on integrating the aria piece. Do you think that launching aria as a console app outside of XOWA would be fine? The main reason why this item has gone unfinished is because I wanted to integrate aria directly within Java and this required more work (relaying messages back and forth from XOWA to aria).

    A separate command-line launch should be simple....

     
  • Anselm D

    Anselm D - 2015-07-09

    I know I've stalled on integrating the aria piece.

    I wrote this as an information for the community and not to make you stress.

    A separate command-line launch should be simple....

    Maybe its enough to make a hint in the documentation?

     
  • gnosygnu

    gnosygnu - 2015-07-10

    I wrote this as an information for the community and not to make you stress.

    Cool. Thanks. :)

    Maybe its enough to make a hint in the documentation?

    Sure! I created a page at home/wiki/Help:Downloading_files_with_aria2 . There's a link to it on home/wiki/Help:Contents under Expert Usage -> Installation.

    The page has the text below. Feel free to let me know if anything should be added / changed

    Thanks!

    [https://github.com/tatsuhiro-t/aria2 aria2] is an open-source application to simplify downloading files.
    
    == Usage ==
    * Place all files in a text file. For example: xowa_image_download_https.txt
    : Note that line endings don't matter. Text files with Windows CRLF will also work on Linux systems like Ubuntu
    * Use the following command-line to start:
    : <code>aria2c --save-session=xowa_image_download_https.txt --input-file=xowa_image_download_https.txt</code>
    * Stop it with Ctrl-C, and resume at a later time. Note that resume information is added to the text file (in this case xowa_image_download_https.txt)
    
     
  • Anselm D

    Anselm D - 2015-07-12

    Thank you, this looks fine :-)

     
  • gnosygnu

    gnosygnu - 2015-07-13

    Cool. Thanks for the confirm. :)

     
  • Anselm D

    Anselm D - 2015-09-07

    Some additional information: A perfect resume only works with http, with https a none finished file starts again.

     
  • gnosygnu

    gnosygnu - 2015-09-07

    Thanks. I updated the doc now. It'll be in the next release under home/wiki/Help:Downloading_files_with_aria2

    * Stop it with Ctrl-C, and resume at a later time. Note that resume information is added to the text file (in this case xowa_image_download_https.txt). Also, a perfect resume only works with http; with https an unfinished file starts again.
    
     

Anonymous
Anonymous

Add attachments
Cancel