A Java implementation of a flexible and extensible web spider engine.
Optional modules allow functionality to be added (searching dead links, testing the performance and scalability of a site, creating a sitemap, etc ..
Hello, I am a MSc student in Addis Ababa University department of computer science, Ethiopia. I am working my MSc thesis on language specific search engine. So, I am using JSpider as a crawling tool. Since I am new for the tool, what configurations should I do on the tool so that it can be used for crawling pages from the web? Regards HB