python-web_excavator download

A general web scraper that uses the requests library to communicate with the website.

Scraper() contains a parser object, which you can add parsing handles to.

ParseHandle() is the code mining for you data from an html source.

Repo: https://github.com/crispycret/web_excavator

Project Activity

See All Activity >

Follow python-web_excavator

python-web_excavator Web Site

Other Useful Business Software

Gen AI apps are built with MongoDB Atlas

The database for AI-powered applications.

MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.

Start Free

Rate This Project

User Reviews

Be the first to post a review of python-web_excavator!

Additional Project Details

Registered

2014-12-15

Similar Business Software

Anysite Scraper

If want to build your own targeted business leads database or want a web data-mining software for a variety of websites then you need a custom web scraper that can scrape specific data according to your business requirements. If you have such requirements then "Anysite Scraper" is the right...

See Software
QuickScraper

Welcome to Quick Scraper - your one-stop shop for lightning-fast HTML extraction from any website, in just one click! We handle proxy servers, browsers, and CAPTCHAs effortlessly, so you can focus on what matters most. Transform data on the fly with our versatile parsers: JSON, CSV, Excel, and...

See Software
WebScraper.io

Making web data extraction easy and accessible for everyone. Our goal is to make web data extraction as simple as possible. Configure scraper by simply pointing and clicking on elements. No coding required. Web Scraper can extract data from sites with multiple levels of navigation. It can...

See Software
Kadoa

Instead of building custom scrapers to extract unstructured data, get the data you want in seconds with our generative AI. Define data, sources, and schedule. Kadoa autogenerates scrapers for the sources and automatically adapts to website changes. Kadoa extracts the data and ensures data...

See Software
WebscrapeAi

WebscrapeAi is the perfect tool for collecting data from the web without the hassle of manual scraping. No coding skills are required. Simply enter the URL and the items you want to scrape, and our AI scraper will do the rest. Our AI scraper uses advanced algorithms to collect data accurately,...

See Software
HasData

Get valuable data at scale in HTML format from any website without the need for a proxy. If you're tired of fiddling with proxies, headless browsers, and captchas, it's time to use HasData (formerly Scrape-It.Cloud). Send the desired URL and we'll return an HTML response. Work without headaches...

See Software