python-web_excavator download

A general web scraper that uses the requests library to communicate with the website.

Scraper() contains a parser object, which you can add parsing handles to.

ParseHandle() is the code mining for you data from an html source.

Repo: https://github.com/crispycret/web_excavator

Project Activity

See All Activity >

Follow python-web_excavator

python-web_excavator Web Site

Other Useful Business Software

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Rate This Project

User Reviews

Be the first to post a review of python-web_excavator!

Additional Project Details

Registered

2014-12-15

Similar Business Software

Anysite Scraper

If want to build your own targeted business leads database or want a web data-mining software for a variety of websites then you need a custom web scraper that can scrape specific data according to your business requirements. If you have such requirements then "Anysite Scraper" is the right...

See Software
QuickScraper

Welcome to Quick Scraper - your one-stop shop for lightning-fast HTML extraction from any website, in just one click! We handle proxy servers, browsers, and CAPTCHAs effortlessly, so you can focus on what matters most. Transform data on the fly with our versatile parsers: JSON, CSV, Excel, and...

See Software
WebScraper.io

Making web data extraction easy and accessible for everyone. Our goal is to make web data extraction as simple as possible. Configure scraper by simply pointing and clicking on elements. No coding required. Web Scraper can extract data from sites with multiple levels of navigation. It can...

See Software
Kadoa

Instead of building custom scrapers to extract unstructured data, get the data you want in seconds with our generative AI. Define data, sources, and schedule. Kadoa autogenerates scrapers for the sources and automatically adapts to website changes. Kadoa extracts the data and ensures data...

See Software
WebscrapeAi

WebscrapeAi is the perfect tool for collecting data from the web without the hassle of manual scraping. No coding skills are required. Simply enter the URL and the items you want to scrape, and our AI scraper will do the rest. Our AI scraper uses advanced algorithms to collect data accurately,...

See Software
HasData

Get valuable data at scale in HTML format from any website without the need for a proxy. If you're tired of fiddling with proxies, headless browsers, and captchas, it's time to use HasData (formerly Scrape-It.Cloud). Send the desired URL and we'll return an HTML response. Work without headaches...

See Software