Easy Spider is a distributed Perl Web Crawler Project from 2006
a Python library for managing shared files
DuckDuckGo from the terminal
A PHP search engine for your website and web analytics tool. GNU GPL3
Google Search, Google Site Search, Google News from the terminal
A website crawler and links downloader command line tool
Very configurable web downloader
XML bindings and a GUI for creating and editing XBMC Scrapers
Auto Rescanning - Search Terms - Regularly Updated With New Features
Indexed cloud file system