Xidel is a command line tool to download web pages and extract data from them.
This data can be extracted using XPath/XQuery 3.0 (with a compatibility modes for XPath 2.0 and XQuery 1.0), JSONiq, CSS 3 selectors, and custom, pattern-matching templates that are like an annotated version of the processed page.
It can download files over HTTP/S connections, follow redirections, links, or extracted values, and also process local files.
The extracted values can then be exported as plain text/XML/JSON, or assigned to variables to use in other extract expressions.
It also provides an online CGI service for testing of XPath / XQuery 3.0 expression.
(Xidel is a part of the VideLibri project, so its project page just redirects there )
Features
- XPath 2.0
- XParh 3.0
- CSS 3.0 selectors
- command line and cgi service
- XQuery 1.0
License
GNU General Public License version 2.0 (GPLv2)Follow Xidel
User Reviews
-
Very nice tool, just lack full XQuery support :/ Swiss Army Knife for web scrapers and tinkering over HTML & XML for daily basis.
-
Simple, easy to use and works great.
-
Excellent tool. Thank you.
