Xidel
Xidel is a cli webpage scraping tool supporting XPath/XQuery 3 and CSS
Xidel is a command line tool to download web pages and extract data from them.
This data can be extracted using XPath/XQuery 3.0 (with a compatibility modes for XPath 2.0 and XQuery 1.0), JSONiq, CSS 3 selectors, and custom, pattern-matching templates that are like an annotated version of the processed page.
It can download files over HTTP/S connections, follow redirections, links, or extracted values, and also process local files.
The extracted values can then be exported as plain...