To make the download of the images more simple, I used the aria2 command line download manager.
I put all the urls of all files to download into a file, and called it:
xowa_image_download_https.txt (this one has windows cr/lf endings, but I was also able to use it at Ubuntu)
With the following command line, it starts. You can stop it with ctrl-c and can resume it with the same command line. (it will change the xowa_image_download_https.txt files and add resume information)
Thanks for the instructions. I know I've stalled on integrating the aria piece. Do you think that launching aria as a console app outside of XOWA would be fine? The main reason why this item has gone unfinished is because I wanted to integrate aria directly within Java and this required more work (relaying messages back and forth from XOWA to aria).
A separate command-line launch should be simple....
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I wrote this as an information for the community and not to make you stress.
Cool. Thanks. :)
Maybe its enough to make a hint in the documentation?
Sure! I created a page at home/wiki/Help:Downloading_files_with_aria2 . There's a link to it on home/wiki/Help:Contents under Expert Usage -> Installation.
The page has the text below. Feel free to let me know if anything should be added / changed
Thanks!
[https://github.com/tatsuhiro-t/aria2 aria2] is an open-source application to simplify downloading files.
== Usage ==
* Place all files in a text file. For example: xowa_image_download_https.txt
: Note that line endings don't matter. Text files with Windows CRLF will also work on Linux systems like Ubuntu
* Use the following command-line to start:
: <code>aria2c --save-session=xowa_image_download_https.txt --input-file=xowa_image_download_https.txt</code>
* Stop it with Ctrl-C, and resume at a later time. Note that resume information is added to the text file (in this case xowa_image_download_https.txt)
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Thanks. I updated the doc now. It'll be in the next release under home/wiki/Help:Downloading_files_with_aria2
* Stop it with Ctrl-C, and resume at a later time. Note that resume information is added to the text file (in this case xowa_image_download_https.txt). Also, a perfect resume only works with http; with https an unfinished file starts again.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
To make the download of the images more simple, I used the aria2 command line download manager.
I put all the urls of all files to download into a file, and called it:
xowa_image_download_https.txt (this one has windows cr/lf endings, but I was also able to use it at Ubuntu)
With the following command line, it starts. You can stop it with ctrl-c and can resume it with the same command line. (it will change the xowa_image_download_https.txt files and add resume information)
At first I had some difficulties with resuming, but the author of aria2 was able to help very fast:
resume download / using --input-file · Issue #431 · tatsuhiro-t/aria2
https://github.com/tatsuhiro-t/aria2/issues/431
Last edit: Anselm D 2015-07-07
Thanks for the instructions. I know I've stalled on integrating the aria piece. Do you think that launching aria as a console app outside of XOWA would be fine? The main reason why this item has gone unfinished is because I wanted to integrate aria directly within Java and this required more work (relaying messages back and forth from XOWA to aria).
A separate command-line launch should be simple....
I wrote this as an information for the community and not to make you stress.
Maybe its enough to make a hint in the documentation?
Cool. Thanks. :)
Sure! I created a page at home/wiki/Help:Downloading_files_with_aria2 . There's a link to it on home/wiki/Help:Contents under Expert Usage -> Installation.
The page has the text below. Feel free to let me know if anything should be added / changed
Thanks!
Thank you, this looks fine :-)
Cool. Thanks for the confirm. :)
Some additional information: A perfect resume only works with http, with https a none finished file starts again.
Thanks. I updated the doc now. It'll be in the next release under home/wiki/Help:Downloading_files_with_aria2