Lightweight .NET framework for fast web crawling and data scraping
Cerberus Content Management System
one server framework
An open source search engine with RESTFul API and crawlers
Make robots for MediaWiki-powered sites!
Federated Framework in PHP and compatible with XOOPS Platforms!
a powerfull c++ library for win32/linux, server framework, HttpServlet