Search Results for "crawler"

Handy, High-performance Nginx firewall module. Such as black and white list of IPs or IP range, uri black and white list, and request body black list, etc. Directives and rules are easy to write and readable. The IP detection is a constant-time operation. Most of the remaining inspections use caching to improve performance. Compatible with ModSecurity's rules, you can use OWASP ModSecurity Core Rule Set. Supports verifying Google, Bing, Baidu and Yandex crawlers and allowing them...

This project has evolved from its original version into Calimero (a new Windows desktop wallpaper manager). Details here: https://sourceforge.net/projects/kalimero/ WallPaper (alias crawlpaper) is a desktop changer (NOT a screensaver) which includes a web crawler for picture download, an audio stream ripper, an audio player, a mini mp3 tag editor,etc. Also included support for .zip and .rar files and an interface to the BerkleyDB code for small databases.

Wizard's Castle - A Classic Text-Based Dungeon Crawler Reborn Embark on an epic quest through a procedurally generated castle in search of the legendary Orb of Zot! This modern reimagining of the 1980 BASIC game combines classic ASCII graphics with enhanced features and multiple implementations. Choose from five unique races (Human, Elf, Hobbit, Dwarf, or Dark Elf), battle fearsome monsters from Kobolds to Dragons, cast powerful spells, and explore 512 rooms filled with treasures, traps, and mysteries. ...

...Windows Users: This tool requires the subversion command line tools: https://sourceforge.net/projects/win32svn/ Credits: Subversion https://subversion.apache.org win32svn https://sourceforge.net/projects/win32svn/ fast-svn-crawler https://sourceforge.net/projects/fastsvncrawler/

This is a futur C library like liburl to simply get webpage. The main goal is to make it the most easier possible. this library also provide some basics functions to create crawler. There is also some kind of string.h

Methanol is a scriptable multi-purpose web crawling system with an extensible configuration system and speed-optimized architectural design. Methabot is the web crawler of Methanol.

Web Crawler & indexer project, for university

Universal information crawler is a fast precise and reliable Internet crawler. Uicrawler is a program/automated script which browses the World Wide Web in a methodical, automated manner and creates the index of documents that it accesses.

A new Web Crawler including sophisticated searching process especialized by language !

PySMBSearch is a crawler and search engine for SMB shares. It consists of a crawler script, which creates an index and stores it in an SQL database, and a CGI script that can be used to extract queries from the database.

FTPList/FTPCrawler is a Multi-threaded and MySQL based FTP Crawler, it has a PHP interface which you can use to search in the database, see FTP status (up, full, down), and more. It's designed for enviorements like big LAN-Partys i.e Remedy.

Harvest is a web indexing package, originally disigned for distributed indexing, it can form a powerful system for indexing both large and small web sites. Also now includes Harvest-NG a highly efficient, modular, perl-based web crawler.

The Open Dungeon Crawler 3D (ODC) is a remake of the classic 90s era 3D dungeon crawlers such as "Eye of The Beholder" and "Dungeon Master". It is initially targeted at the GameCube and desktop OSes.