Be the first to post a text review of PHP Crawler. Rate and review a project by clicking thumbs up or thumbs down in the right column.

View all reviews

• Tracker artifact added

  Anonymous created the Problem with preg_match_all in phpcrawlerutils.class.php artifact

  posted by nobody 117 days ago

• Tracker artifact added

  Anonymous created the Caching word lookup? Add Index to words table. artifact

  posted by nobody 416 days ago

• Forum thread added

  selvamurali created the crawl doesnot working forum thread

  posted by selvamurali 829 days ago

• Tracker artifact added

  zoltak created the Base HREF not being considered and incorrect links result artifact

  posted by zoltak 845 days ago

• File released: /php-crawler-0.8-testing/php-crawler-0.8/phpcrawler-0.8.tar.bz2

  posted 851 days ago

• php-crawler-0.8-testing php-crawler-0.8 file released: phpcrawler-0.8.tar.bz2

  ==== 0.8 Engine redesigned + search.php: uses head.php and footer.php along with _config.php options for what to include in the top and bottom parts of the page * search.php: templated search results + _config.php: added HTML headers/footers options + _config.php: added crawling extension options + _config.php: added characters to use to represent words options + _config.php: added search options * _crawler.php: new way to add crawled pages into database * _db.php: safer mysql queries + _db.php: hash to text etc. conversion functions + _search.php: everything needed to search the new way * crawler.php: crawls as it should by making hashes of content ==== 0.7.7 * search.php: full URL is shown when page title is empty + crawler.php: Connection handling adder (Useful when you run crawler from browser) + crawler.php: Page size printing added + _crawler.php: HTML comments removal added * _crawler.php: URL locator fixed. Now matches URLs with spaces (href = "http//...") ==== 0.7.6 Several non-critical bugs fixed. Broken redirect (I'm sorry) fixed. * crawler.php: page counter fixed * _config.php: config $CRAWL_DB_DISABLE_KEYS now false by default * _crawler.php: "FAILED" links was not removed from DB * _crawler.php: "SKIPPED" links recrawling fixed (unset_url_from_db function) * index.html: redirect to search.php fixed

  posted 851 days ago

• Tracker artifact added

  Anonymous created the hi artifact

  posted by nobody 995 days ago

• Forum thread added

  sdexp created the Project Collaboration forum thread

  posted by sdexp 996 days ago

• Broken archive

  Archive for 0.7.7 version was zero-lenght, sorry. Fixed.

  posted by astellar 1381 days ago

• php-crawler php-crawler-0.7.7-alpha file released: php-crawler-0.7.7-alpha.zip

  ==== 0.7.7 * search.php: full URL is shown when page title is empty + crawler.php: Connection handling adder (Useful when you run crawler from browser) + crawler.php: Page size printing added + _crawler.php: HTML comments removal added * _crawler.php: URL locator fixed. Now matches URLs with spaces (href = "http//...")

  posted 1381 days ago