crwlr Files

Library for Rapid (Web) Crawler and Scraper Development

This is an exact mirror of the crwlr project, hosted at https://github.com/crwlrsoft/crawler. SourceForge is not affiliated with crwlr.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2026-05-03	56 Bytes	0
v3.5.8 source code.tar.gz	2026-05-03	88.0 kB	0
v3.5.8 source code.zip	2026-05-03	154.6 kB	0
Totals: 3 Items		242.6 kB	0

Source: README.md, updated 2026-05-03

Other Useful Business Software

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build, govern, and optimize agents and models with Gemini Enterprise Agent Platform.

Start Free

Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.

Start Free

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build, govern, and optimize agents and models with Gemini Enterprise Agent Platform.

Start Free

Recommended Projects

Heritrix
Internet Archive's open-source, web-scale, web crawler project
Spatie Crawler
An easy to use, powerful crawler implemented in PHP
Scriptilitious
ScriptBox for several terminal (Bash/Konsole) utilities. Current utilities include: sitemap-ripper - merges sitemaps, sitmap-maker - makes sitemaps, url-extractor - extracts URLs, url2hyperlink - makes links of URLs, file splitter - splits files
crawler
A toolchain for bringing web2 to web3
crawlergo
Headless Chrome crawler for collecting URLs for vulnerability scans