Ex-Crawler is divided into 3 subprojects (Crawler Daemon, distributed gui Client, (web) search engine) which together provide a flexible and powerful search engine supporting distributed computing. More informations: http://ex-crawler.sourceforge.net
Features
- Fast web and image crawler written in Java which follows new links automaticly on a priority algorithm and can run 24h a day.
- Uses MySQL, MSSQL, PostgreSQL or even SQLlite Database to store informations
- Comes with a web frontend search engine, direct website analysis and more (in development - SVN)
- Support for distributed crawling with a graphical frontend for non-advanced users (de.excrawler.distributed.client in svn)
- Comes with it's own server where you can add new sites and much more including UserManagement and more.
- Comes with an plugin interface, with it you can easily add your own features in no time
- And much more
License
GNU General Public License version 3.0 (GPLv3)Follow Ex-Crawler
Other Useful Business Software
Paessler: Easy to Use With Enterprise Power. Free Trial
You shouldn't have to choose between a monitoring tool that's easy to use and one that's powerful enough for a complex environment. PRTG's low-code interface lets any admin build dashboards, set alerts and monitor devices without scripting, while custom sensors and full API access are there when your team needs deeper control. One platform, no compromise. Download a free 30-day trial now.
Rate This Project
Login To Rate This Project
User Reviews
-
Ex-crawler is good! Thanks.