The archive-crawler project is building a flexible, extensible, robust, and scalable web crawler capable of fetching, archiving, and analyzing the full diversity and breadth of internet-accesible content.
Project Admins:
gojomo, ia_igor, jlee-archive, johnerik, kristinn_sig, nlevitt, paul_jack, rstata, stack-sf
Operating System:
OS Independent (Written in an interpreted language)
License:
GNU Library or Lesser General Public License (LGPL)
Category:
Internet
Buy expert services from Sourceforge.net Marketplace. Support from the people who know.