Download
Other spiders has a limited link depth, follows links not randomized or are combined with heavy indexing machines. This spider will has not link depth limits, randomize next url, that will be checked for new urls.
License
GNU General Public License version 2.0 (GPLv2)Follow Simple Web Spider
Other Useful Business Software
Resolve Support Tickets 2x Faster with ServoDesk
What if You Could Automate 90% of Your Repetitive Tasks in Under 30 Days? At ServoDesk, we help businesses like yours automate operations with AI, allowing you to cut service times in half and increase productivity by 25% - without hiring more staff.
Rate This Project
Login To Rate This Project
User Reviews
-
This is an interesting project. Don't forget to add the java bin directory to your PATH environment variable if you're going to try this.
