WebCollector

WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.

Github:
https://github.com/CrawlScript/WebCollector

Demo:
https://github.com/CrawlScript/WebCollector/blob/master/YahooCrawler.java

Project Samples

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow WebCollector

WebCollector Web Site

You Might Also Like

SKUDONET Open Source Load Balancer

Take advantage of Open Source Load Balancer to elevate your business security and IT infrastructure with a custom ADC Solution.

SKUDONET ADC, operates at the application layer, efficiently distributing network load and application load across multiple servers. This not only enhances the performance of your application but also ensures that your web servers can handle more traffic seamlessly.

Learn More

Rate This Project

User Reviews

Be the first to post a review of WebCollector!

Additional Project Details

Languages

English, Chinese (Simplified)

Programming Language

Java

Related Categories

Java Search Engines, Java Web Scrapers

Registered

2014-07-21

Similar Business Software

PromptCloud

Our web scraping services are fully customizable. You can change source websites, frequency of data collection, data points being extracted and data delivery mechanisms can be analyzed based on your specific requirements. The data-aggregation feature of our web crawler helps clients to get data...

See Software
Infospace

InfoSpace is a leading provider of white label search and monetization solutions. We serve a network of more than 100 web publishers globally, offering core search solutions as a proven means to monetize audience via a search-based advertising revenue stream. Our technology selects from the top...

See Software
AnyPicker

AnyPicker is a powerful yet easy-to-use web scraper for the Chrome browser. Scrape the entire website using only your mouse, no coding skills are required, and no tedious configuration is needed; it’s that simple and easy. AnyPicker can be operated with just mouse clicks. AnyPicker automatically...

See Software

Report inappropriate content