WebCorpus Files

Hadoop framework for scalable processing of large web corpora

Status: Beta

Brought to you by: biem-tuda, johannes_simon, remstef

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
leipzig_example_en.txt	2013-03-11	2.4 MB	0
leipzig_example_de.txt	2013-03-11	2.1 MB	0
Totals: 2 Items		4.6 MB	0

Other Useful Business Software

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Start Free

Earn up to 16% annual interest with Nexo.

Access competitive interest rates on your digital assets.

Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform. Geographic restrictions, eligibility, and terms apply.

Get started with Nexo.

$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.

Start Free

Recommended Projects

grab-site
Web crawler for archiving and backing up sites into WARC archives
Natural Language Toolkit
NLTK Source
Heritrix: Internet Archive Web Crawler
The archive-crawler project is building Heritrix: a flexible, extensible, robust, and scalable web crawler capable of fetching, archiving, and analyzing the full diversity and breadth of internet-accesible content.
Fuzzy sets for Ada
Fuzzy sets, logic, numbers; intuitionistic fuzzy sets, fuzzy linguis
IMS Open Corpus Workbench
Indexing and query tools for very large text corpora