Xidel is a command line tool to download web pages and extract data from them.
This data can be extracted using XPath/XQuery 3.0 (with a compatibility modes for XPath 2.0 and XQuery 1.0), JSONiq, CSS 3 selectors, and custom, pattern-matching templates that are like an annotated version of the processed page.
It can download files over HTTP/S connections, follow redirections, links, or extracted values, and also process local files.
The extracted values can then be exported as plain text/XML/JSON, or assigned to variables to use in other extract expressions.
It also provides an online CGI service for testing of XPath / XQuery 3.0 expression.
(Xidel is a part of the VideLibri project, so its project page just redirects there )
Features
- XPath 2.0
- XParh 3.0
- CSS 3.0 selectors
- command line and cgi service
- XQuery 1.0
License
GNU General Public License version 2.0 (GPLv2)Follow Xidel
Other Useful Business Software
Our Free Plans just got better! | Auth0
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Rate This Project
Login To Rate This Project
User Reviews
-
Very nice tool, just lack full XQuery support :/ Swiss Army Knife for web scrapers and tinkering over HTML & XML for daily basis.
-
Simple, easy to use and works great.
-
Excellent tool. Thank you.