GPT Crawler Files

Crawl a site to generate knowledge files to create your own custom GPT

This is an exact mirror of the GPT Crawler project, hosted at https://github.com/BuilderIO/gpt-crawler. SourceForge is not affiliated with GPT Crawler.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2025-01-23	236 Bytes	0
v1.5.1 source code.tar.gz	2025-01-23	47.9 kB	0
v1.5.1 source code.zip	2025-01-23	54.6 kB	2
Totals: 3 Items		102.7 kB	2

1.5.1 (2025-01-23)

Bug Fixes

correctly set cookies (567ab0b)

Source: README.md, updated 2025-01-23

Other Useful Business Software

Gemini 3 and 200+ AI Models on One Platform

Access Google's best plus Claude, Llama, and Gemma. Fine-tune and deploy from one console.

Build generative AI apps with Vertex AI. Switch between models without switching platforms.

Start Free

Fully Managed MySQL, PostgreSQL, and SQL Server

Automatic backups, patching, replication, and failover. Focus on your app, not your database.

Cloud SQL handles your database ops end to end, so you can focus on your app.

Try Free

Recommended Projects

Spatie Crawler
An easy to use, powerful crawler implemented in PHP
Crawl4AI
Open-source LLM Friendly Web Crawler & Scraper
crawler4j
Open source web crawler for Java
Firecrawl
Turn entire websites into LLM-ready markdown or structured data
Easyspider - Distributed Web Crawler
Easy Spider is a distributed Perl Web Crawler Project from 2006

GPT Crawler Files

Crawl a site to generate knowledge files to create your own custom GPT

Get an email when there's a new version of GPT Crawler

1.5.1 (2025-01-23)

Bug Fixes