A Java implementation of a flexible and extensible web spider engine.Optional modules allow functionality to be added (searching dead links, testing the performance and scalability of a site, creating a sitemap, etc ..
This project seems to be dead (last release in 2003). Also, I tried running it and, after downloading successfully for a while, it threw an exception and entered an infinite loop where no pages were being downloaded.
Copyright © 2009 Geeknet, Inc. All rights reserved. Terms of Use
Thanks for your rating!
Would you also like to write a review?