Ex-Crawler is divided into 3 subprojects (Crawler Daemon, distributed gui Client, (web) search engine) which together provide a flexible and powerful search engine supporting distributed computing. More informations: http://ex-crawler.sourceforge.net

Features

  • Fast web and image crawler written in Java which follows new links automaticly on a priority algorithm and can run 24h a day.
  • Uses MySQL, MSSQL, PostgreSQL or even SQLlite Database to store informations
  • Comes with a web frontend search engine, direct website analysis and more (in development - SVN)
  • Support for distributed crawling with a graphical frontend for non-advanced users (de.excrawler.distributed.client in svn)
  • Comes with it's own server where you can add new sites and much more including UserManagement and more.
  • Comes with an plugin interface, with it you can easily add your own features in no time
  • And much more

Project Samples

Ex-Crawler Distributed GUI Client with first run assistant Distributed Client Server Manager Overview over some of the server commands in telnet session Ex-Crawler Search Engine screenshot (PHP, in Browser)

Project Activity

See All Activity >

Categories

Search Engines, Distributed Computing, Information Analysis

License

GNU General Public License version 3.0 (GPLv3)

Follow Ex-Crawler

Ex-Crawler Web Site

Other Useful Business Software
$300 Free Credits for Your Google Cloud Projects Icon
$300 Free Credits for Your Google Cloud Projects

Start building on Google Cloud with $300 in free credits. No commitment, no credit card required until you're ready to scale.

Launch your next project with $300 in free Google Cloud credits—no strings attached. Test, build, and deploy without risk. Use your credits across the entire Google Cloud platform to find what works best for your needs. After your credits are used, continue with always-free tier services. Only pay when you're ready to scale. Sign up in minutes and start exploring.
Start Free Trial
Rate This Project
Login To Rate This Project

User Ratings

5.0 out of 5 stars
★★★★★
★★★★
★★★
★★
★
1
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5

User Reviews

Filter Reviews:
All
  • marcophoenix Posted 2013-06-20
    Ex-crawler is good! Thanks.
    1 user found this review helpful.
Read more reviews >

Additional Project Details

Operating Systems

Linux, Mac, Solaris, Windows

Languages

English

Intended Audience

Advanced End Users, Developers, Education, End Users/Desktop, Science/Research, System Administrators

User Interface

Command-line, Java Swing, Non-interactive (Daemon), Web-based

Programming Language

Java, PHP

Database Environment

JDBC, Microsoft SQL Server, MySQL, PostgreSQL (pgsql), SQLite

Related Categories

PHP Search Engines, PHP Distributed Computing Software, PHP Information Analysis Software, Java Search Engines, Java Distributed Computing Software, Java Information Analysis Software

Registered

2010-03-02
Report inappropriate content