DeDuplicator (Heritrix add-on) download

The DeDuplicator is an add-on module (plug-in) for the web crawler Heritrix. It offers a means to reduce the amount of duplicate data collected in a series of snapshot crawls.

Project Activity

See All Activity >

License

GNU Library or Lesser General Public License version 2.0 (LGPLv2)

Follow DeDuplicator (Heritrix add-on)

DeDuplicator (Heritrix add-on) Web Site

User Reviews

Be the first to post a review of DeDuplicator (Heritrix add-on)!

Additional Project Details

Languages

English

Intended Audience

Advanced End Users, System Administrators, Developers

User Interface

Plugins

Programming Language

Java

Related Categories

Java Internet Software, Java Web Scrapers

Registered

2006-11-06

Similar Business Software

NeoCertified Secure Email

NeoCertified protects sensitive information through our secure email application across our versatile Cloud-based platform on any web browser, through Microsoft Office 365/Outlook plug-ins, and Gmail integration. iPhone + Android mobile apps are also available directly on your mobile...

See Software
Opera

Opera is the personal browser chosen for hundreds of millions of people around the world. Opera is the faster browser with less processing capacity than other browsers with a built-in ad blocker that helps load webpages faster. Opera browser has a free integrated VPN that reduces online...

See Software
Price2Spy

We make automatic price adjustments easy to perform and take almost no time. Since our launch back in 2011. we have gathered significant experience across numerous industries over the years and know how each industry’s prices function. Price2Spy helps eCommerce professionals monitor, track,...

See Software

Report inappropriate content