This project is a java web spider (web crawler) with the ability to download (and resume) files. It is also highly customizable with regular expressions and download templates. All backend functionalities are also available in a separate library.
Categories
Web ScrapersLicense
GNU General Public License version 2.0 (GPLv2)Follow ItSucks
Other Useful Business Software
Enterprise-grade ITSM, for every business
Freshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
Rate This Project
Login To Rate This Project
User Reviews
-
thanks man, great soft!
-
As webmaster/seo I use ItSucks to simulate search engine bots, this is vary useful especially if we want to see how far bots crawling our page, where it goes, and for the most important see the header response whenever a bots engine found a link. And I already use ItSucks as an official standard for my company.
-
very userful application