Search Results for "collection"

...WaterCrawl supports customizable extraction rules so users can focus only on relevant elements while ignoring unnecessary page components. WaterCrawl also offers real-time monitoring capabilities, allowing users to track crawling progress, performance metrics, and errors during large data collection jobs. Developers can integrate the tool into applications through a REST API and multiple client SDKs, enabling automated data pipelines and AI data preparation workflows.

...DotnetSpider is modular, allowing different components such as request schedulers, downloaders, and storage systems to work together in a flexible workflow. DotnetSpider also supports distributed crawling environments, making it possible to scale data collection across multiple agents and machines. With support for various storage backends and extensible parsing mechanisms, it is suitable for building complex scraping systems or automated data gathering pipelines.

Version 0.5 is available. How to update: http://penbang.sysbase.org/install_tools/0.5/Readme.txt Penbang has been tested on crunchbang Penbang is a collection of tools aimed at the openbox environment. It includes Network Exploits, Vulnerability Assessment/Exploits, Network Analysis, Social Engineering tools, I.G.C, dsniff suite, and irpas. As well as a simple way of launching them. *machinebacon of LinuxBBQ has made a fine distribution out of penbang. http://linuxbbq.org/bbs/viewtopic.php?...

WebBuild is a collection of scripts for Cygwin or UNIX shells, using awk and sed, to develop HTML pages in an easy way, having a template and source files containing the content to publish.

heimconnect is a small collection of Unix/Linux shell scripts that make it easy to connect to the internet in residences of the Austrian OEJAB student home organization. Its core is a backend consisting of the heim-ein and heim-aus scripts, but a few dist

The aw script is written so that you can browse web sites through the command line by specifying where to look at in a concise manner. It can also be used to make an excerpt of web sites.

A small collection of my unix scripts written for my personal utility.

Pagegen is a collection of Bash scripts for static web site generation, meaning it creates web sites from flat text files and directories. Great for managing a site from the command line.

FIRST SAY aggregates content and document metadata using XML/RSS feeds and memeio-xml (http://xml.memeio.org). It is designed to make a first page presentation showing the most recently updated content from a collection of such feeds.

Booth is a collection of python and bash shell scripts that facilitate the creation and maintenance of Firefox based web kiosks. It brings together many of the commonly used techniques of locking down Mozilla and provides a pre-made solution for users.

PHPRPMs is a collection of tools required to build PHP extensions "missing" from your RedHat/Fedora distribution (such as mhash, mcrypt, FDFtk, mssql, SQLite, APC, APD, dBase, filePro and others) as RPM add-ons to your "factory" PHP packages.

A collection of software to implement search engine technology. The overall search technology is built on the individual components of this project, each component is released under the BSD License, and is written in the language most suited to its task.

nto or nto.it is the collection of script and programm for build a static and/or dynamic version of the site www.nto.it (a personal italian bookmaker of talent person find in the web.). I hope which this work is useful for to promote talent or for build

Rav Antivirus Log Analysis Kit is a collection of scripts that parse the RAV logs and insert the data into a database. Also included is a php front-end that will allow the display of this information.

A collection of scripts for using netacctd with MySQL. Import your 'flat-file' DB into a real one. :)

A Collection of utilities, daemons, scripts, web pages that makes life a lot easier for system administrators (esp. those who work for/in an Internet Service Provider(s)).