Other spiders has a limited link depth, follows links not randomized or are combined with heavy indexing machines. This spider will has not link depth limits, randomize next url, that will be checked for new urls.

Project Activity

See All Activity >

Categories

Search Engines, Web Scrapers

License

GNU General Public License version 2.0 (GPLv2)

Follow Simple Web Spider

Simple Web Spider Web Site

You Might Also Like
Gain insights and build data-powered applications Icon
Gain insights and build data-powered applications

Your unified business intelligence platform. Self-service. Governed. Embedded.

Chat with your business data with Looker. More than just a modern business intelligence platform, you can turn to Looker for self-service or governed BI, build your own custom applications with trusted metrics, or even bring Looker modeling to your existing BI environment.
Try it free
Rate This Project
Login To Rate This Project

User Ratings

5.0 out of 5 stars
★★★★★
★★★★
★★★
★★
★
1
0
0
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 0 / 5

User Reviews

Filter Reviews:
★★★

There are no 3 star reviews.

Additional Project Details

Languages

English

Intended Audience

Advanced End Users

User Interface

Non-interactive (Daemon), Console/Terminal, Command-line

Programming Language

Java

Database Environment

JDBC

Related Categories

Java Search Engines, Java Web Scrapers

Registered

2008-12-21
Report inappropriate content