Search Results for "data analysis"

unfluff is a Node.js library designed to automatically extract the main content from an HTML document — stripping away navigation bars, ads, footers and other boilerplate to leave you with the “body content”, metadata (title, author, date) and other useful fields. It’s a tool very much aimed at content-analysis, web scraping, building datasets, or repurposing article text for downstream processing (like machine-learning or summarization). The API is simple: you feed in raw HTML and it...

Jericho HTML Parser is a java library allowing analysis and manipulation of parts of an HTML document, including server-side tags, while reproducing verbatim any unrecognised or invalid HTML.

Irudiko is a library written in C++ for generating Locality Sensitive Hashing sketches from any textual and web document. Mainly designed to work with HTML pages, it has also an optimization support for English or Italian documents.

WebVizTools is a set of scripts to help visualize larger web sites and hunt down orphaned files.

ICECrawler is a WWW crawler and map-generator intended to help understanding and analyzing links between websites and webdocuments.

The Open Log Engine is a powerful tool for advanced logging in games or programs. It easily allows you to make logging outputs in your program and analyse them afterwards with the Open Log Viewer, which provides you a powerful filtering system.

What is a domain-specific language intended for constructing web services on top of ordinary web pages, or otherwise automate web-related tasks. Using a powerful pattern matching sublanguage, What strives to be for XML/HTML what Perl is for text analysis