Crawler Icon

Crawler

alpha
Add a Review
3 Downloads (This Week)
Last Update:
Download crawler.zip
Browse All Files

Description

Crawler is a bare-bones spider designed to quickly and effectively build an index of all files and pages on a given Web site as well as the link relationship (both incoming and outgoing) between each page. More open source at https://github.com/fcc.

Crawler Web Site

Update Notifications





Write a Review

User Reviews

Be the first to post a review of Crawler!

Additional Project Details

Intended Audience

Government

User Interface

Web-based

Programming Language

PHP

Registered

2010-09-03
Screenshots can attract more users to your project.
Features can attract more users to your project.

Icons must be PNG, GIF, or JPEG and less than 1 MiB in size. They will be displayed as 48x48 images.