Harvest is a web indexing package, originally disigned for distributed indexing, it can form a powerful system for indexing both large and small web sites. Also now includes Harvest-NG a highly efficient, modular, perl-based web crawler.
Project Admins:
sxw
Operating System:
All POSIX (Linux/BSD/UNIX-like OSes)
License:
GNU General Public License (GPL)
Category:
Indexing/Search, Link Checking
Buy expert services from Sourceforge.net Marketplace. Support from the people who know.