Search Results for "search engine crawler php"

...Consumers integrate it to decide whether a specific URL may be fetched by a particular bot name and to respect crawl-delay or sitemaps hints where applicable. The library serves both search-scale crawlers and smaller tools that need a reliable decision engine for polite crawling.

The article explains the design and the characteristics of a new open source content aggregation system. Among the features of the program, stands out a new processing engine of syndication channels, monitoring capability of information recovery in real time, the possibilities of the configuration of aggregator behavior, automatic classification of contents and new models for representation of information from relational interactive maps. On the other hand, the aggregation program, which...

Intelligent e-knowledge base engine for any kind of knowledge-based applications, supporting effective knowledge presentation, precise knowledge search, adaptive learning and immediate consulting.

This application implement an approach for doing keyword based search over semi-structured data available in HTML pages.

A system to perform analysis of large documents for the purpose of cataloging similar documents. Similarity is based upon contextual analysis of these documents done by identifying common words and proper nouns.

Ex-Crawler is divided into 3 subprojects (Crawler Daemon, distributed gui Client, (web) search engine) which together provide a flexible and powerful search engine supporting distributed computing. More informations: http://ex-crawler.sourceforge.net

TSE is a test bed for a web service approach to federating taxonomic name databases. Put in English, it takes your query and talks to a number of different databases, asking each one whether they contain that name.