Audience

Web Scraping framework for developers

About Scrapy

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing. Built-in support for selecting and extracting data from HTML/XML sources using extended CSS selectors and XPath expressions, with helper methods to extract using regular expressions. Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends (FTP, S3, local filesystem). Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding declarations.

Integrations

API:
Yes, Scrapy offers API access

Ratings/Reviews

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Company Information

Scrapy
scrapy.org

Videos and Screen Captures

Scrapy Screenshot 1
Other Useful Business Software
Find Hidden Risks in Windows Task Scheduler Icon
Find Hidden Risks in Windows Task Scheduler

Free diagnostic script reveals configuration issues, error patterns, and security risks. Instant HTML report.

Windows Task Scheduler might be hiding critical failures. Download the free JAMS diagnostic tool to uncover problems before they impact production—get a color-coded risk report with clear remediation steps in minutes.
Download Free Tool

Product Details

Platforms Supported
Cloud
Training
Documentation
Support
Online

Scrapy Frequently Asked Questions

Q: What kinds of users and organization types does Scrapy work with?
Q: What languages does Scrapy support in their product?
Q: What other applications or services does Scrapy integrate with?
Q: Does Scrapy have an API?
Q: What type of training does Scrapy provide?

Scrapy Product Features