This project is made for automatic web scraping to make scraping easy. It gets a URL or the HTML content of a web page and a list of sample data that we want to scrape from that page. This data can be text, URL or any HTML tag value of that page. It learns the scraping rules and returns similar elements. Then you can use this learned object with new URLs to get similar content or the exact same element of those new pages.

Features

  • Scrape live stock prices from yahoo finance
  • Fetch all related post titles in a stackoverflow page
  • We can now save the built model to use it later
  • You can also pass any custom requests module parameter
  • A smart, automatic, fast and lightweight web scraper for Python
  • Use the scraper object to get related topics of any stackoverflow page

Project Samples

AutoScraper Screenshot 1

Project Activity

See All Activity >

Categories

Web Scrapers

License

MIT License

Follow AutoScraper

AutoScraper Web Site

Other Useful Business Software
Build Securely on Azure with Proven Frameworks Icon
Build Securely on Azure with Proven Frameworks

Lay a foundation for success with Tested Reference Architectures developed by Fortinet’s experts. Learn more in this white paper.

Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
Download Now
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of AutoScraper!

Additional Project Details

Programming Language

Python

Related Categories

Python Web Scrapers

Registered

2023-04-12
Report inappropriate content