Lightweight .NET framework for fast web crawling and data scraping
Cerberus Content Management System
An open source search engine with RESTFul API and crawlers
Make robots for MediaWiki-powered sites!
Federated Framework in PHP and compatible with XOOPS Platforms!