php-cralwler is a small and very simple fulltext crawl/search script for small and middle websites. Written on PHP it requires no shell access and can be run directly from browser.
New 0.7.7 version includes seral improvement and bug fixes:
- crawler now print page size.
- HTML comments removal added.
- URL locator fixed. Now matches URLs with spaces (href = "http//...")
Log in to post a comment.