Retriever: a light, extensible crawler download

Retriever is a simple crawler packed as a Java library that allows developers to collect and manipulate documents reachable by a variety of protocols (e.g. http, smb). You'll easily crawl documents shared in a LAN, on the Web, and many other sources.

Project Activity

See All Activity >

License

Apache License V2.0

Follow Retriever: a light, extensible crawler

Retriever: a light, extensible crawler Web Site

Other Useful Business Software

Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.

Start Free

Rate This Project

User Reviews

Be the first to post a review of Retriever: a light, extensible crawler!

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Other toolkit

Programming Language

Java

Related Categories

Java Search Engines

Registered

2007-12-03

Similar Business Software

Perplexity

Perplexity is an AI-powered search and answer engine designed to provide accurate, real-time information. It combines natural language processing with web search to deliver concise and reliable answers. Users can ask questions conversationally and receive responses backed by cited sources. The...

See Software
Google

Our mission is to organize the world's information so that everyone can access and use it. Every time you search, there are thousands, sometimes millions, of webpages with helpful information. How Google figures out which results to show starts long before you even type, and is guided by a...

See Software
DuckDuckGo

Get free, continuous protection for your privacy in the browser with one download. Browse as usual and we take care of the rest. We offer you search engine, tracker blocker and encryption enhancement all in one Chrome extension. Search privately with our app or extension, add private web search...

See Software
Luxxle

Luxxle is a next-generation search engine that prioritizes privacy, quality, and real-time results without tracking users or storing their data. It uses real-time crawling and indexing, ensuring the most up-to-date and relevant results, unlike search engines relying on outdated databases. Luxxle...

See Software
Ecosia

Ecosia is a search engine and browser experience built to turn everyday web activity into meaningful climate action. Every search helps fund global reforestation efforts, resulting in millions of trees planted across biodiversity hotspots. The company reinvests 100% of its profits into climate...

See Software
Swisscows

Since we never collect your data, we never track your data! We respect your privacy! It is in our DNA to protect every user! With Swisscows you are 100% anonymous! Have our own servers and do not work with a cloud or third party! Family is the most important cell of our society! If morality and...

See Software

Report inappropriate content