Xidel is a command line tool to download web pages and extract data from them.
This data can be extracted using XPath/XQuery 3.0 (with a compatibility modes for XPath 2.0 and XQuery 1.0), JSONiq, CSS 3 selectors, and custom, pattern-matching templates that are like an annotated version of the processed page.
It can download files over HTTP/S connections, follow redirections, links, or extracted values, and also process local files.
The extracted values can then be exported as plain text/XML/JSON, or assigned to variables to use in other extract expressions.
It also provides an online CGI service for testing of XPath / XQuery 3.0 expression.
(Xidel is a part of the VideLibri project, so its project page just redirects there )
Features
- XPath 2.0
- XParh 3.0
- CSS 3.0 selectors
- command line and cgi service
- XQuery 1.0
License
GNU General Public License version 2.0 (GPLv2)Follow Xidel
You Might Also Like
New Plans, same great Auth0 | Auth0 by Okta
In our new Free Plan, you'll receive more MAUs than ever. You'll also be able to add Passwordless authentication, use your own custom domain, and more. Our expanded Paid Plans include increased connections, more MFA offerings, and more. Check out what's new.
Rate This Project
Login To Rate This Project
User Reviews
-
Very nice tool, just lack full XQuery support :/ Swiss Army Knife for web scrapers and tinkering over HTML & XML for daily basis.
-
Simple, easy to use and works great.
-
Excellent tool. Thank you.