There is no plan to add spider functionality.
I think spider focuses on how to parse html, css, script and find links rather than downloading file in a reliable way.
aria2 is very much focused on downloading file and spider functionality is out of its scope.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
There is no plan to add spider functionality.
I think spider focuses on how to parse html, css, script and find links rather than downloading file in a reliable way.
aria2 is very much focused on downloading file and spider functionality is out of its scope.