Retriever: a light, extensible crawler download

Retriever is a simple crawler packed as a Java library that allows developers to collect and manipulate documents reachable by a variety of protocols (e.g. http, smb). You'll easily crawl documents shared in a LAN, on the Web, and many other sources.

Project Activity

See All Activity >

License

Apache License V2.0

Follow Retriever: a light, extensible crawler

Retriever: a light, extensible crawler Web Site

Other Useful Business Software

Grafana: The open and composable observability platform

Faster answers, predictable costs, and no lock-in built by the team helping to make observability accessible to anyone.

Grafana is the open source analytics & monitoring solution for every database.

Learn More

Rate This Project

User Reviews

Be the first to post a review of Retriever: a light, extensible crawler!

Additional Project Details

Languages

English

Intended Audience

Developers

User Interface

Other toolkit

Programming Language

Java

Related Categories

Java Search Engines

Registered

2007-12-03

Similar Business Software

Perplexity

Where knowledge begins. Perplexity is an AI search engine that gives you quick answers. Available for free at as a web app, desktop app, or on the go on iPhone or Android. Perplexity AI is an advanced search and question-answering tool that leverages large language models to provide...

See Software
Google

Our mission is to organize the world's information so that everyone can access and use it. Every time you search, there are thousands, sometimes millions, of webpages with helpful information. How Google figures out which results to show starts long before you even type, and is guided by a...

See Software
DuckDuckGo

Get free, continuous protection for your privacy in the browser with one download. Browse as usual and we take care of the rest. We offer you search engine, tracker blocker and encryption enhancement all in one Chrome extension. Search privately with our app or extension, add private web search...

See Software
Luxxle

Luxxle is a next-generation search engine that prioritizes privacy, quality, and real-time results without tracking users or storing their data. It uses real-time crawling and indexing, ensuring the most up-to-date and relevant results, unlike search engines relying on outdated databases. Luxxle...

See Software
Swisscows

Since we never collect your data, we never track your data! We respect your privacy! It is in our DNA to protect every user! With Swisscows you are 100% anonymous! Have our own servers and do not work with a cloud or third party! Family is the most important cell of our society! If morality and...

See Software
Startpage

As kids, we’re all taught not to touch stuff that doesn’t belong to us. It’s a good guideline. So why are online companies harvesting our personal data without our consent? They shouldn’t. That’s why we’re developing online tools that help you stay in control of your personal information. Search...

See Software