Crawler Detect Files

CrawlerDetect is a PHP class for detecting bots/crawlers/spiders

This is an exact mirror of the Crawler Detect project, hosted at https://github.com/JayBizzle/Crawler-Detect. SourceForge is not affiliated with Crawler Detect.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2026-10-20	1.3 kB	0
v1.4.2 source code.tar.gz	2026-10-20	37.1 kB	0
v1.4.2 source code.zip	2026-10-20	49.4 kB	3
Totals: 3 Items		87.7 kB	3

What's Changed

Normalise header names so non-SAPI sources work by @JayBizzle in https://github.com/JayBizzle/Crawler-Detect/pull/617
Add AI agent signatures; force PCRE JIT on for the test suite by @JayBizzle in https://github.com/JayBizzle/Crawler-Detect/pull/618
Add issue forms with required fields by @JayBizzle in https://github.com/JayBizzle/Crawler-Detect/pull/623
Detect IronFountain-Leads, TheWebReport and webshopok-kutatas by @Halfacht in https://github.com/JayBizzle/Crawler-Detect/pull/624
Tighten exclusions so they cannot eat part of a signature by @JayBizzle in https://github.com/JayBizzle/Crawler-Detect/pull/620
Clarify that getMatches() returns the matched text, not a bot name by @JayBizzle in https://github.com/JayBizzle/Crawler-Detect/pull/628
Add 9bot by @9-bot in https://github.com/JayBizzle/Crawler-Detect/pull/629
Add CyberConvoyScout by @uwereiher in https://github.com/JayBizzle/Crawler-Detect/pull/630

New Contributors

@9-bot made their first contribution in https://github.com/JayBizzle/Crawler-Detect/pull/629
@uwereiher made their first contribution in https://github.com/JayBizzle/Crawler-Detect/pull/630

Full Changelog: https://github.com/JayBizzle/Crawler-Detect/compare/v1.4.1...v1.4.2

Source: README.md, updated 2026-10-20

Other Useful Business Software

Build Securely on AWS with Proven Frameworks Icon

Build Securely on AWS with Proven Frameworks

Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.

Download Now

Host LLMs in Production With On-Demand GPUs Icon

Host LLMs in Production With On-Demand GPUs

NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.

Start Free

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Start Free

Recommended Projects

FEAPDER
Powerful Python crawler framework for scalable web scraping tasks
Python Crawler Tutorial Starts From Zero
Python crawler tutorial, taking you from zero to one
OpenSearchServer Search Engine
An open source search engine with RESTFul API and crawlers
Image Crawler
The image crawler application is used to collect a multitude of images from websites. The images can be viewed as thumbnails or saved to a given folder for enhanced processing. (Html and XML report are generated)
TubeKit
TubeKit is a toolkit for creating YouTube crawlers. It allows one to build one's own crawler that can crawl YouTube based on a set of seed queries and collect up to 17 different attributes.