Search Results for "patterns"

...It implements the core semantics of the Robots Exclusion Protocol: user-agent sections, Allow/Disallow directives, wildcard handling, and precedence rules. The code is optimized for speed and low memory so large crawls can evaluate millions of URLs quickly. It also focuses on correctness—edge cases like overlapping patterns and longest-match resolution are handled consistently. Consumers integrate it to decide whether a specific URL may be fetched by a particular bot name and to respect crawl-delay or sitemaps hints where applicable. The library serves both search-scale crawlers and smaller tools that need a reliable decision engine for polite crawling.

Miro is a robotics middleware. It uses CORBA for the middleware layer and provides OO-RPC as well as pub/sub communication patterns. Currently supported platforms include Pioneers, the B21, some robot soccer robots and various robotic sensors.

ManFieLd is an easy-to-use framework to develop filtering applications for Distributed System, relieving the burden of the developer to write the support code for the filtering methods.