A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl and index any web or enterprise domain and is configurable through a XML configuration file.
Features
- link checking
- load-testing
- website downloading
License
GNU General Public License version 3.0 (GPLv3)Follow phoneutria
You Might Also Like
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of phoneutria!