A Java implementation of a flexible and extensible web spider engine.
Optional modules allow functionality to be added (searching dead links, testing the performance and scalability of a site, creating a sitemap, etc ..
Rate This ProjectLogin To Rate This Project
Hello, I am a MSc student in Addis Ababa University department of computer science, Ethiopia. I am working my MSc thesis on language specific search engine. So, I am using JSpider as a crawling tool. Since I am new for the tool, what configurations should I do on the tool so that it can be used for crawling pages from the web? Regards HB
No progress on this, I suppose... Crawler4j(2008) and Nutch(2009) are the on going ones and have stable releases also ...
Seems outdated. The linkchecker doesn't work; results in exceptions.