Search Results for "links"

...It enables developers and researchers to crawl web pages, extract meaningful information, and convert it into formats that are easier to process and analyze. It provides a modern crawling system that can automatically navigate links, control crawl depth, and collect content from targeted sections of a website. WaterCrawl supports customizable extraction rules so users can focus only on relevant elements while ignoring unnecessary page components. WaterCrawl also offers real-time monitoring capabilities, allowing users to track crawling progress, performance metrics, and errors during large data collection jobs. ...

grab-site is an open source web crawling tool designed to archive and back up websites by recursively downloading their content. It works by taking a starting URL and systematically following links across the site, capturing pages and resources and saving them into WARC archive files for long-term preservation. Internally, the crawler uses a fork of the wpull engine to fetch and process web pages efficiently during large-scale crawls. grab-site includes a built-in dashboard that displays real-time crawl activity, including which URLs are currently being processed and how many remain in the queue. ...

This software allows you to download files from more than 50 (oneclick-)hosters (like youtube, rapidshare and many more). It is the perfect platform to download http and ftp links only with your Fritz!Box controlled by a graphical web-interface. Get the latest version at https://sourceforge.net/p/avmload/code/HEAD/tarball?path=/trunk

...The supported url schemes are ftp, scp, http, https, gridftp, file and nfs, with the possibility to perform authentication using basic FTP/HTTP authentication or more advanced SSO authentication schemas. The application analyses HTML pages to follow links and redirects, parses RDF and ATOM feeds, supports downloads of URL lists, automatically decompresses files and directories and many other feature. Tool works on a generic Linux distribution or on Windows (for windows, you need to install "Git for Windows")

Junksurf takes control of your firefox browser to adulterate your interests in the world wide web by automatic browsing. Currently JunkSurf is a simple bash script to instruct firefox to browse some sites in random times, for instance if you are not at home. It gets new links from this sites and updating automaticly its database with destination addresses. The background: ------------------------ The government of countries instruct ISPs to save all the browsing data. Of course, only for safety! Privacy is not an option. You are creating junk data by using Junksurf. -- More information join the wiki --

Penetration-Testing-Toolkit is a web based project to automate Scanning a network,Exploring CMS, Generating Undectable metasploit payload, DNS-Queries, IP related informations, Information Gathering, Domain related info etc

Framework (scripts, configuration, code) to build free and public services around travel and leisure data. That project makes an extensive use of already existing data sources such as Geonames and dbPedia, and adds some glue around those (eg, links).

System to allow personal ad-hoc anonymous ftp space for file sharing. Very simple. Space is available with anonymous ftp and/or http. No user accounts needed, URLs are obfuscated to keep file spaces private, however links may be shared. Runs on any *nix. such as a hacked pogoplug device running Arch.

FreeNX is a free server implementation of NoMachine.com OSS NX components. NX allows usage of X-connections over real slow links like a Modem or ISDN.

Chronicle is a set of BASH shell scripts that use rsync to back up data to a remote host. Snapshots are created and rotated using hard links to minimize storage requirements.

A two floppies Linux distribution with a graphical web browser (links with SVGALIB), a text mode IRC client (rhapsody), configuration scripts with "dialog" front-ends, almost all of the Ethernet drivers from the latest 2.6.x kernel, PPP, ssh and more.

This software project aims to create an easy to use eBay hidden counter system in php that reports more accurate, more informative, free, and just more data than commercial auction counter tools. Links your auctions to a php script that logs connections.

Online photo album written in Ruby. Catalogues photos with event, location, time etc. The journal facility allows a entry to be added with inline preview photos or links to location or event searches.

XicadaNet links many private networks together into one large private network, for pedagogical purposes. Individuals running nodes on this network will be able to experiment safely with advanced networking technologies.