A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl and index any web or enterprise domain and is configurable through a XML configuration file.
Features
- link checking
- load-testing
- website downloading
License
GNU General Public License version 3.0 (GPLv3)Follow phoneutria
Other Useful Business Software
Powering the best of the internet | Fastly
Ensure your websites, applications and services can effortlessly handle the demands of your users with Fastly. Fastly’s portfolio is designed to be highly performant, personalized and secure while seamlessly scaling to support your growth.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of phoneutria!