SmartCrawler

SmartCrawler is a java-based fully configurable, multi-threaded and extensible crawler, which is able to fetch and analyze the contents of a web site by using dinamically pluggable filters

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow SmartCrawler

SmartCrawler Web Site

Other Useful Business Software

Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.

Start Free

Rate This Project

User Reviews

Be the first to post a review of SmartCrawler!

Additional Project Details

Languages

English

Intended Audience

Developers, End Users/Desktop

User Interface

Command-line

Programming Language

Java

Related Categories

Java Search Engines

Registered

2005-06-14

Similar Business Software

Perplexity

Perplexity is an AI-powered search and answer engine designed to provide accurate, real-time information. It combines natural language processing with web search to deliver concise and reliable answers. Users can ask questions conversationally and receive responses backed by cited sources. The...

See Software
Perplexity Pro

Perplexity Pro is the most powerful way to search the internet with unlimited Pro Search, upgraded AI models, unlimited file upload, image generation, and API credits. Perplexity Pro is a premium offering from the Perplexity AI platform, designed to provide users with a more advanced and...

See Software
Google

Our mission is to organize the world's information so that everyone can access and use it. Every time you search, there are thousands, sometimes millions, of webpages with helpful information. How Google figures out which results to show starts long before you even type, and is guided by a...

See Software
Yahoo Search

Yahoo dials up what people love most with apps and sites like Yahoo Sports, Yahoo Finance, Yahoo Fantasy, Yahoo Mail and more in the works everyday. We reach millions of people around the globe and connect advertisers with just the right audiences to help build their brands and businesses. Yahoo...

See Software
DuckDuckGo

Get free, continuous protection for your privacy in the browser with one download. Browse as usual and we take care of the rest. We offer you search engine, tracker blocker and encryption enhancement all in one Chrome extension. Search privately with our app or extension, add private web search...

See Software
Infospace

InfoSpace is a leading provider of white label search and monetization solutions. We serve a network of more than 100 web publishers globally, offering core search solutions as a proven means to monetize audience via a search-based advertising revenue stream. Our technology selects from the top...

See Software