GPT Crawler Files

Crawl a site to generate knowledge files to create your own custom GPT

This is an exact mirror of the GPT Crawler project, hosted at https://github.com/BuilderIO/gpt-crawler. SourceForge is not affiliated with GPT Crawler.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
v1.2.1 source code.tar.gz	2024-01-04	46.8 kB	0
v1.2.1 source code.zip	2024-01-04	53.4 kB	0
Totals: 2 Items		100.3 kB	0

Other Useful Business Software

Easily Host LLMs and Web Apps on Cloud Run

Run everything from popular models with on-demand NVIDIA L4 GPUs to web apps without infrastructure management.

Run frontend and backend services, batch jobs, host LLMs, and queue processing workloads without the need to manage infrastructure. Cloud Run gives you on-demand GPU access for hosting LLMs and running real-time AI—with 5-second cold starts and automatic scale-to-zero so you only pay for actual usage. New customers get $300 in free credit to start.

Try Cloud Run Free

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Recommended Projects

Spatie Crawler
An easy to use, powerful crawler implemented in PHP
Crawl4AI
Open-source LLM Friendly Web Crawler & Scraper
crawler4j
Open source web crawler for Java
Firecrawl
Turn entire websites into LLM-ready markdown or structured data
Easyspider - Distributed Web Crawler
Easy Spider is a distributed Perl Web Crawler Project from 2006

GPT Crawler Files

Crawl a site to generate knowledge files to create your own custom GPT

Get an email when there's a new version of GPT Crawler