Java Robot Exclusion Compliance Library download

A Java library for complying with the standard Web Robot Exclusion Protocol, robots.txt.

Project Activity

See All Activity >

License

GNU Library or Lesser General Public License version 2.0 (LGPLv2)

Follow Java Robot Exclusion Compliance Library

Java Robot Exclusion Compliance Library Web Site

Other Useful Business Software

Go from Code to Production URL in Seconds

Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.

Try it free

Rate This Project

User Reviews

Be the first to post a review of Java Robot Exclusion Compliance Library!

Additional Project Details

Intended Audience

Developers

User Interface

Non-interactive (Daemon)

Programming Language

Java

Related Categories

Java Search Engines

Registered

2009-01-24

Similar Business Software

Perplexity

Perplexity is an AI-powered search and answer engine designed to provide accurate, real-time information. It combines natural language processing with web search to deliver concise and reliable answers. Users can ask questions conversationally and receive responses backed by cited sources. The...

See Software
Google

Our mission is to organize the world's information so that everyone can access and use it. Every time you search, there are thousands, sometimes millions, of webpages with helpful information. How Google figures out which results to show starts long before you even type, and is guided by a...

See Software
Ecosia

Ecosia is a search engine and browser experience built to turn everyday web activity into meaningful climate action. Every search helps fund global reforestation efforts, resulting in millions of trees planted across biodiversity hotspots. The company reinvests 100% of its profits into climate...

See Software
MyAllSearch

MyAllSearch is a privacy search engine that helps you to protect your privacy online. We believe in a search experience that doesn't result in an invasion of your online privacy. While other search engines store every search you ever type, we hold your privacy above everything else. We know...

See Software
DuckDuckGo

Get free, continuous protection for your privacy in the browser with one download. Browse as usual and we take care of the rest. We offer you search engine, tracker blocker and encryption enhancement all in one Chrome extension. Search privately with our app or extension, add private web search...

See Software
Qwant

Qwant is a European digital alternative made in France. Qwant guarantees the privacy and security of your searches on the web and contributes to the development of the digital economy of the European Union. Our teams are located in France, Germany and Italy. Our servers are located in Rouen...

See Software