DownloadOpenWebSpider is an Open Source multi-threaded Web Spider (robot, crawler) and search engine with a lot of interesting features!
Project Samples
License
MIT License
You Might Also Like
Deploy Red Hat Ansible Automation Platform on Microsoft Azure for a strategic automation solution that allows you to orchestrate, govern and operationalize your Azure environment.
Rate This Project
Login To Rate This Project
User Reviews
-
Congratulations, very complete search tool! Guy, please, how to configure the login/password for proxy client/server?
-
as with a lot of these projects, they don't run on windows without errors such as 'node' is not recognized as an internal or external command popping up. But I can't complain, it's free, but the average person will have to spend a few hours figuring out how to get it to work or reconfiguring windows to run scripts.
-
Well done
-
Nice work ! Great project.