+
+

Related Products

  • Oxylabs
    1,145 Ratings
    Visit Website
  • Gaffa
    5 Ratings
    Visit Website
  • Apify
    1,441 Ratings
    Visit Website
  • Bright Data
    1,404 Ratings
    Visit Website
  • Price2Spy
    236 Ratings
    Visit Website
  • NetNut
    579 Ratings
    Visit Website
  • LM-Kit.NET
    29 Ratings
    Visit Website
  • Okyline
    2 Ratings
    Visit Website
  • 3Q
    14 Ratings
    Visit Website
  • PackageX OCR Scanning
    48 Ratings
    Visit Website

About

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing. Built-in support for selecting and extracting data from HTML/XML sources using extended CSS selectors and XPath expressions, with helper methods to extract using regular expressions. Built-in support for generating feed exports in multiple formats (JSON, CSV, XML) and storing them in multiple backends (FTP, S3, local filesystem). Robust encoding support and auto-detection, for dealing with foreign, non-standard and broken encoding declarations.

About

jsoup is a Java library that simplifies working with real-world HTML and XML. It offers an easy-to-use API for URL fetching, data parsing, extraction, and manipulation using DOM API methods, CSS, and XPath selectors. jsoup implements the WHATWG HTML5 specification and parses HTML to the same DOM as modern browsers. With jsoup, you can scrape and parse HTML from a URL, file, or string; find and extract data using DOM traversal or CSS selectors; manipulate HTML elements, attributes, and text; clean user-submitted content against a safelist to prevent XSS attacks; and output tidy HTML. jsoup is designed to deal with all varieties of HTML found in the wild, from pristine and validating to invalid tag-soup, creating a sensible parse tree. For example, you can fetch the Wikipedia homepage, parse it to a DOM, and select the headlines from the "In the news" section into a list of elements.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Web Scraping framework for developers

Audience

Java developers in search of a tool to parse, extract, and manipulate data from HTML and XML documents

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Scrapy
scrapy.org

Company Information

jsoup
jsoup.org

Alternatives

Apify

Apify

Apify Technologies s.r.o.

Alternatives

parsel

parsel

Python Software Foundation

Categories

Categories

Integrations

CSS
DataImpulse
Databay
GitHub
HTML
Lime Proxies
Live Proxies
Model Context Protocol (MCP)
Oxylabs
PrivateProxy.me
ProxyJet
Python
Zyte

Integrations

CSS
DataImpulse
Databay
GitHub
HTML
Lime Proxies
Live Proxies
Model Context Protocol (MCP)
Oxylabs
PrivateProxy.me
ProxyJet
Python
Zyte
Claim Scrapy and update features and information
Claim Scrapy and update features and information
Claim jsoup and update features and information
Claim jsoup and update features and information