Download
Other spiders has a limited link depth, follows links not randomized or are combined with heavy indexing machines. This spider will has not link depth limits, randomize next url, that will be checked for new urls.
License
GNU General Public License version 2.0 (GPLv2)Follow Simple Web Spider
Other Useful Business Software
Keep company data safe with Chrome Enterprise
Make AI work your way with Chrome Enterprise. Block unapproved sites and set custom data controls that align with your company's policies.
Rate This Project
Login To Rate This Project
User Reviews
-
This is an interesting project. Don't forget to add the java bin directory to your PATH environment variable if you're going to try this.
