Crawler is a bare-bones spider designed to quickly and effectively build an index of all files and pages on a given Web site as well as the link relationship (both incoming and outgoing) between each page. More open source at https://github.com/fcc.

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow Crawler

Crawler Web Site

Other Useful Business Software
Get Avast Free Antivirus | Your top-rated shield against malware and online scams Icon
Get Avast Free Antivirus | Your top-rated shield against malware and online scams

Boost your PC's defense against cyberthreats and web-based scams.

Our antivirus software scans for security and performance issues and helps you to fix them instantly. It also protects you in real time by analyzing unknown files before they reach your desktop PC or laptop — all for free.
Free Download
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Crawler!

Additional Project Details

Intended Audience

Government

User Interface

Web-based

Programming Language

PHP

Database Environment

SQL-based

Related Categories

PHP Search Engines, PHP Site Management Software

Registered

2010-09-03