Search Results for "crawl" - Page 5

Retriever is a simple crawler packed as a Java library that allows developers to collect and manipulate documents reachable by a variety of protocols (e.g. http, smb). You'll easily crawl documents shared in a LAN, on the Web, and many other sources.

Simple Porn Downloader is a tiny all Java based application that uses a list of keywords and starting urls to crawl webpages and branch out searching for specific media extensions which are downloaded and presented in an html page.

InfoCrawler allows you to crawl and index various types of documents, accessing data from various resources: Intranets, public WEB sites, local or remote file systems. For product information please see our website at http://www.infocrawler.org/

ZhuaShuShell is a set of bash scripts to crawl online html e-books from certain Chinese e-book sites and save the data that is formatted as a single text book to your local machine.The newest codes and usage is here:http://tinyurl.com/2d573k (in Chinese)

Sharehound is a network file systems indexer and searcher written in Java. Currently supports SMB file shares (i.e. MS Windows-based shares) and FTP resources. Web UI is used for search and crawl monitoring. RSS feed is provided for search results.

Ruya is a Python-based breadth-first, level-, delayed, event-based-crawler for crawling English, Japanese websites. It is targeted solely towards developers who want crawling functionality in their projects using API, and crawl control.

This is simple link checker. It can crawl any site and help to find broken links. It also having download CSV report option.The CSV file includes url ,parent page url and status of page [broken or ok]. It is be very useful for search engine optimization.

PythonSlash (py/,for short) is an multiplataform engine for real time dungeon crawl games written in python. The included sample - game is intended to be a Diablo - like game, fun and fast paced.

Crawl-By-Example runs a crawl, which classifies the processed pages by subjects and finds the best pages according to examples provided by the operator. Crawl-By-Example is a plugin to the Heritrix crawler, and was done as a part of GSoC06 program.

PK-Torrents is a PHP torrent lister based on torrenthoster v1.0. It has the functionality to crawl the top torrent sites, Meganova, Mininova, Piratebay, Snarf, Torrentportal, Torrentspy.

Crawl a LiveJournal-based blog hosting for friends data. LiveJournal is a blog hosting engine that allows its users to list others as friends. This tool can download most of the data about friendship relations between users for later processing.

Java application that will crawl the web for Bittorrent files using an innovative plugin system, decode torrent files, and store pertinent information in a DBMS. A front end search engine will be added that pulls from the TorrentMech populated database.

Easy to use command line utility for checking the integrity of websites. The app will crawl a site to a specified depth and report any errors encounter in an easy to understand report. Written in Python so it's portable. Can be invoked from cgi or cron.

Toke is a webmining toolkit for web exploring, indexing and searching for Java. Toke allows to you crawl public or private web sites, in order to create web estatistics, web Pajek graphs, Lucene indexs and word frequency files for data clustering.

A suite of tools to crawl, parse and extract meaningful information from web documents.

This is a rewrite of Linley Henzell's game Crawl in C++. Crawl is a rogue-like similar to games like Moria, Angband, and NetHack.

FTPSeek is an opensource (GPL) script which has the capability to crawl multiple FTP servers, allowing you to instantly search multiple servers at once, and browse through the file structures of each server at your will.

ApMl provides users with the ability to crawl the web and download pages to their computer in a directory structure suitable for a Machine Learning system to both train itself and classify new documents. Classification Algorithms include Naive Bayes, KNN

FemFind is a crawler/search engine for SMB shares (which can be found on Windows or Unix systems running Samba). FemFind does also crawl FTP servers and provides a web interface and a Windows client as frontends for searching.

Spindexer is a Search Engine/Crawler tool similar to UDMsearch or ht://dig - but unlike these tools, Spindexer is *very* fast and flexible. A simple Perl script works as a front-end to Pavuk and Swish++, allowing a fast crawl across any site(s).

Squishy Bugs is a console based game, much in the vain of the X game xbill. Bugs '0' crawl up your terminal and the aim is to "squish" them by pressing any mouse button with your cursor over the mouse.

Open source, tower-defense-styled adaptation of roguelike game Dungeon Crawl Stone Soup.

Blackfire Player is a powerful Web Crawling, Web Testing, and Web Scraper application. It provides a nice DSL to crawl HTTP services, assert responses, and extract data from HTML/XML/JSON responses. Some Blackfire Player use cases: Crawl a website/API and check expectations -- aka Acceptance Tests; Scrape a website/API and extract values; Monitor a website; Test code with unit test integration (PHPUnit, Behat, Codeception, ...); Test code behavior from the outside thanks to the native Blackfire Profiler integration -- aka Unit Tests from the HTTP layer (tm). ...