Robust featureful multi-threaded CLI web spider using apache commons httpclient v3.0 written in java. ASpider downloads any files matching your given mime-types from a website. Tries to reg.exp. match emails by default, logging all results using log4j.

Project Activity

See All Activity >

Categories

Browsers, Search Engines, Link Checking, Web Scrapers

License

BSD License

Follow ASpider

ASpider Web Site

Other Useful Business Software
Your top-rated shield against malware and online scams | Avast Free Antivirus Icon
Your top-rated shield against malware and online scams | Avast Free Antivirus

Browse and email in peace, supported by clever AI

Our antivirus software scans for security and performance issues and helps you to fix them instantly. It also protects you in real time by analyzing unknown files before they reach your desktop PC or laptop — all for free.
Free Download
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of ASpider!

Additional Project Details

Languages

English

Intended Audience

End Users/Desktop

User Interface

Command-line

Programming Language

Java

Database Environment

Flat-file

Related Categories

Java Browsers, Java Search Engines, Java Link Checking Software, Java Web Scrapers

Registered

2004-12-15
Report inappropriate content