URL Web Crawler

It is basicly a program that can make you a search engine. It is a web crawler, has all the web site source code (in ASP, soon to be PHP as well), and a mysql database.

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow URL Web Crawler

URL Web Crawler Web Site

Other Useful Business Software

No-Nonsense Code-to-Cloud Security for Devs | Aikido

Connect your GitHub, GitLab, Bitbucket, or Azure DevOps account to start scanning your repos for free.

Aikido provides a unified security platform for developers, combining 12 powerful scans like SAST, DAST, and CSPM. AI-driven AutoFix and AutoTriage streamline vulnerability management, while runtime protection blocks attacks.

Start for Free

Rate This Project

User Reviews

Be the first to post a review of URL Web Crawler!

Additional Project Details

Operating Systems

Windows

Languages

English

Intended Audience

System Administrators, Developers, End Users/Desktop

User Interface

Win32 (MS Windows)

Programming Language

ASP, C++

Related Categories

ASP Search Engines, ASP Web Scrapers, C++ Search Engines, C++ Web Scrapers

Registered

2001-09-05

Similar Business Software

Lobstr.io

Get the data you need. Lobstr is a web scraping software that offers ready-made no-code solution to collect data from websites. Users can extract information from sources like social media, e-commerce sites, and search engines. Best no-code scrapers are: * Google Maps Search...

See Software
Piloterr

Piloterr API handles crawlers and rotates proxies for you. Piloterr is a software platform that enables forward-thinking companies to leverage the full potential of the web. Piloterr gives you the tools and know-how to grow your business faster. We are always expanding our code and...

See Software
Infospace

InfoSpace is a leading provider of white label search and monetization solutions. We serve a network of more than 100 web publishers globally, offering core search solutions as a proven means to monetize audience via a search-based advertising revenue stream. Our technology selects from the top...

See Software