Xidel is a command line tool to download web pages and extract data from them.
This data can be extracted using XPath/XQuery 3.0 (with a compatibility modes for XPath 2.0 and XQuery 1.0), JSONiq, CSS 3 selectors, and custom, pattern-matching templates that are like an annotated version of the processed page.
It can download files over HTTP/S connections, follow redirections, links, or extracted values, and also process local files.
The extracted values can then be exported as plain text/XML/JSON, or assigned to variables to use in other extract expressions.
It also provides an online CGI service for testing of XPath / XQuery 3.0 expression.
(Xidel is a part of the VideLibri project, so its project page just redirects there )
Features
- XPath 2.0
- XParh 3.0
- CSS 3.0 selectors
- command line and cgi service
- XQuery 1.0
License
GNU General Public License version 2.0 (GPLv2)Follow Xidel
Other Useful Business Software
MongoDB Atlas runs apps anywhere
MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Rate This Project
Login To Rate This Project
User Reviews
-
Very nice tool, just lack full XQuery support :/ Swiss Army Knife for web scrapers and tinkering over HTML & XML for daily basis.
-
Simple, easy to use and works great.
-
Excellent tool. Thank you.