Robust featureful multi-threaded CLI web spider using apache commons httpclient v3.0 written in java. ASpider downloads any files matching your given mime-types from a website. Tries to reg.exp. match emails by default, logging all results using log4j.

Project Activity

See All Activity >

Categories

Browsers, Search Engines, Link Checking, Web Scrapers

License

BSD License

Follow ASpider

ASpider Web Site

You Might Also Like
Top-Rated Free CRM Software Icon
Top-Rated Free CRM Software

216,000+ customers in over 135 countries grow their businesses with HubSpot

HubSpot is an AI-powered customer platform with all the software, integrations, and resources you need to connect your marketing, sales, and customer service. HubSpot's connected platform enables you to grow your business faster by focusing on what matters most: your customers.
Get started free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of ASpider!

Additional Project Details

Languages

English

Intended Audience

End Users/Desktop

User Interface

Command-line

Programming Language

Java

Database Environment

Flat-file

Related Categories

Java Browsers, Java Search Engines, Java Link Checking Software, Java Web Scrapers

Registered

2004-12-15
Report inappropriate content