Spidertron is a multithreaded web crawling API for web sites of moderate size (hundreds of thousands of pages) that allows you to focus not on the crawling but on processing of the information retreived.
Categories
Search EnginesLicense
GNU General Public License version 2.0 (GPLv2)Follow Spidertron webcrawler API
You Might Also Like
Red Hat Enterprise Linux on Microsoft Azure
Red Hat Enterprise Linux (RHEL) on Microsoft Azure provides a secure, reliable, and flexible foundation for your cloud infrastructure. Red Hat Enterprise Linux on Microsoft Azure is ideal for enterprises seeking to enhance their cloud environment with seamless integration, consistent performance, and comprehensive support.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Spidertron webcrawler API!