Search Results for "python web crawler"

Zero Install is a decentralised cross-distribution software installation system. Create one package that works everywhere! With dependency handling and automatic updates, full support for shared libraries, and integration with native package managers

Pholcus is a high-concurrency crawler software written in pure Go language that supports distributed, only used for programming learning and research. It supports three operating modes of stand-alone, server and client, and has three operating interfaces, Web, GUI, and command line; simple and flexible rules, concurrent batch tasks, and rich output methods (mysql/mongodb/kafka/csv/excel, etc.); In addition, it also supports horizontal and vertical grabbing modes, and a series of advanced functions such as simulated login and task suspension and cancellation. ...

webapp-config is the installer for web-based applications of the Gentoo Linux distribution. It is being used for the automatic setup of web applications in a virtual hosting environment.

Mnet is a distributed file store. It is formed by an emergent network of autonomous nodes which self-organize to make the network robust and efficient.

The aim of the OpenGrid project is to enable personal high-performance grid computations. More specific, issues of configuration, deployment, controlling and monitoring of embarrassingly parallel computations are addressed.