Open Source Python Internet Software - Page 62

mlscraper is a Python library designed to automatically extract structured data from HTML pages without requiring developers to manually write CSS selectors or XPath rules. Instead of defining extraction logic by hand, users provide a few examples of the data they want to retrieve from a webpage. It analyzes those examples within the HTML document and determines patterns or rules that can be used to extract the same type of information from similar pages. Once trained, the generated scraper can process new pages and return the extracted data in structured formats such as dictionaries or lists. This approach simplifies web scraping tasks by shifting the focus from rule-writing to example-based training. Internally, the project processes HTML documents, identifies relevant elements in the DOM, and builds extraction logic based on statistical or heuristic analysis of the training samples. The result is a developer-oriented tool that aims to automate common scraping workflows.

Addition to payment system Cyberplat (http://cyberplat.com). Provide monitoring by browser, include PDA.

mod_npy is alternative way of running Python scripts under Apache - alternative to having mod_python installed, or running as CGI. It allows mixing Python code with HTML much like PHP. It's a mixture of Python power and PHP style page writing.

Publish and subscribe messaging for the Web, and related tools. Our license is BSD.

mod_snake is a plugin for Apache which allows modules to be written in Python, and have the same power as C modules. In addition it accelerates Python written CGI, similar to Py_Apache and mod_python and includes support for HTML with embedded Python.

A simple Apache module to convert a txt2tags file on the fly into a HTML file and send it to client browser.

moerAskip enables the user to save, edit and switch network profiles. These profiles will include ip address, dns, printer, samba, webserver, desktop apps etc. settings. As of version 0.3 moerAskip will run on all platforms.

Monmaster is a web site and web application monitoring tool written in Python. You define pages, servers, tests, and applications, and Monmaster can test and restart apps. Notification of error and recovery status via email is available, as is a web UI

mfr or multi ftp relay is a program that makes possible accessing multiple ftp servers in a NATted (or otherwise private) network;data connections (eg. upload and download) will not be relayed,exploiting the high velocity of these networks.

Read daily Taiwan news by pre-defined keywords.

A pet project to help me get acquainted with the twitter api. Written in python and wx_python.

MyStIc is a free FTP gui client developped in python 2.7

mzitu is a Python-based web crawling project designed to automatically download and organize image galleries from a specific photography site. It demonstrates how to build a scraper that navigates gallery pages, retrieves image links, and saves the images locally in a structured directory layout. It focuses on automating the collection of large sets of images by programmatically parsing page content and iterating through gallery entries. mzitu also includes a simple analysis script that processes downloaded folder names to generate statistics and visualizations. Using text segmentation and frequency analysis, the project can create a word cloud representing common keywords found in the dataset. This makes the repository both a scraping example and a small data analysis experiment built around the collected content. Overall, mzitu serves as a learning-oriented implementation of Python web scraping, data processing, and visualization techniques.

name-cgi is a python script, that allows programs using http to get iors from omniNames. It has a loadbalancing feature, this lets you put an orb on a number of boxes and the script will return the ior randomly.If an orb is dead, name-cgi should remove

Python script for pushing the same configuration (stored in a predefined file) on multiple devices at the same time via SSHv2. The script reads the IPs of the devices from the NETWORK_IP file, then gets the SSHv2/Telnet credentials from the SSH_USERPASS file and sends the commands you enter in the CMD_FILE file to all the devices. The script also checks if all the needed files exist, if all the IP addresses are valid and if all the devices are reachable. Tools used: Python 2.7.3, GNS3, Linux.

A python based adaptive network analyzer. The aim of the project is to identify illegitimate uses of bandwidth in a network. Uses tshark for network data gathering.

This repository aggregates tools, guides, and configuration files aimed at enabling network access in restrictive environments across desktop and mobile platforms. It collects client applications, one-click browser bundles, configuration examples, and references for widely used proxy and tunneling technologies. The emphasis is on approachability: instructions, packaged builds, and links are organized so non-experts can find a workable setup for their device. Because endpoint reliability and availability change over time, the project is maintained as a living resource with frequent updates and alternatives. It also includes how-to materials for self-hosting and basic operational hygiene so users can better manage their own connectivity. The goal is practical empowerment—reduce friction, centralize information, and provide options suited to different networks and risk tolerances.

news-please is an open source news crawler and information extraction tool designed to collect and structure articles from online news websites. It provides an integrated pipeline that crawls news sites, retrieves article pages, and extracts structured information such as headlines, authors, publication dates, and article text. news-please can recursively follow internal links and read RSS feeds to gather both recent and archived articles from a news outlet when given only the root URL of a site. It combines several established technologies and libraries to perform web crawling and content extraction, enabling reliable processing across a wide range of news sources. Developers can use the software either as a standalone command line application or integrate it into their own Python applications through its library interface. Extracted article data can be stored in different formats and systems, including JSON files or database-backed storage solutions.

Newspaper4k is a Python library designed for extracting, processing, and analyzing news articles from websites. It is a continuation and active fork of the original newspaper3k library, which had stopped receiving updates, with the goal of keeping the ecosystem maintained while adding improvements and bug fixes. It provides developers with tools to automatically download web pages, extract the main article content, and collect associated metadata such as titles, authors, images, and publication dates. Newspaper4k also includes natural language processing capabilities that can generate summaries and identify keywords from extracted article text. Newspaper4k supports both single-article extraction and full news site processing, allowing users to build sources representing entire publications and iterate through their articles. It maintains compatibility with the original project so that existing code written for newspaper3k can continue working with minimal changes.

downloads files from usenet using nzb files

nginx-proxy sets up a container running nginx and docker-gen. docker-gen generates reverse proxy configs for nginx and reloads nginx when containers are started and stopped. The containers being proxied must expose the port to be proxied, either by using the EXPOSE directive in their Dockerfile or by using the --expose flag to docker run or docker create and be in the same network. By default, if you don't pass the --net flag when your nginx-proxy container is created, it will only be attached to the default bridge network. This means that it will not be able to connect to containers on networks other than bridge.

niab - Network In A Box. Create a virtual lab network inside one machine. A lab can include routers, firewalls, clients and servers connected by a network specified by you. [Linux Network Simulator, UML, user mode linux]

node-gyp is a cross-platform command-line tool written in Node.js for compiling native addon modules for Node.js. It contains a vendored copy of the gyp-next project that was previously used by the Chromium team, extended to support the development of Node.js native addons. Note that node-gyp is not used to build Node.js itself. Multiple target versions of Node.js are supported (i.e. 0.8, ..., 4, 5, 6, etc.), regardless of what version of Node.js is actually installed on your system (node-gyp downloads the necessary development files or headers for the target version). node-gyp requires that you have installed a compatible version of Python, one of: v3.6, v3.7, v3.8, or v3.9. If you have multiple Python versions installed, you can identify which Python version node-gyp should use. A binding.gyp file describes the configuration to build your module, in a JSON-like format. This file gets placed in the root of your package, alongside package.json.

oSync will continue its service via www.osync.com

OCG (Operational Center Geneva) Intranet Platform