Open Source Linux Link Checking Software

New Homepage: http://wummel.github.io/linkchecker/ Linkchecker features: - recursive and multithreaded checking and site crawling - output in colored or normal text, HTML, SQL, CSV, XML or a sitemap graph in different formats - HTTP/1.1, HTTPS, FTP, mailto:, news:, nntp:, Telnet and local file links support - restrict link checking with regular expression filters for URLs - proxy support - username/password authorization for HTTP, FTP

NekoHTML is a simple HTML scanner and tag balancer that enables application programmers to parse HTML documents and access the information using standard XML interfaces.

HTTraQt is the clone from WinHTTrack, software for downloading of internet sites or/and content of their: multimedia files, documents, images, etc. Possible to easy switch the language of GUI, Easy to add the language files without to change the program code. Selection of browser little bit changed: possible to select browser and system of "User agent". Extended the selectiing of file extensions under "Rulez" settings. This project was develloped for Linux/Unix/BSD, but it's possible to change the CMakeLists.txt for Windows and Mac OSX. For compiling You need to install the Qt4, httrack, httrack-dev libraries from repository.

PHP Server Monitor is a script that checks whether your websites and servers are up and running. It comes with a web based user interface where you can manage your services and websites, and you can manage users for each server with a mobile number and email address. For services a connection will be made to the entered ip or domain, on the given port. This way you can check if certain services on your machine are still running. To check your IMAP service for example, enter port 143. For websites you can enter a link and it will check the HTTP status code. If the HTTP status code is in the 4xx range or a timeout, it means an error occurred and the tool will start sending out notifications. You can also set a regular expression to match for content on the page itself. Each server has its own settings regarding notification. You can choose for email, text message (SMS) and Pushover.net notifications. For more info please visit http://www.phpservermonitor.org

Bookmark-Manager is an advanced bookmark management utility for Windows supporting importing/exporting and merging of Internet Explorer favorites, Opera hotlists, Mozilla, Netscape, and Firefox bookmarks, XBEL, and HTML lists.

HarvestMan is a fully functional, multithreaded webcrawler cum offline-browser. It is highly customizable and supports as much as 55 plus options for controlling and customizing offline browsing. It is written entirely in the Python programming language.

A simple app that crawls a website and creates HTML and Google Sitemaps compatible XML sitemap.

Cross platform GUI managing bookmarks and shortcuts in a portable way. Support import/export, search, encryption, hierarchical tags, USB key installation, various environments integration, OS-dependent shortcuts, plugins extensibility.

Xaraya is an Open Source web application framework and content management solution written in PHP and licensed under the GNU General Public License. Xaraya is extensible, uses robust permissions, and multilingual systems to dynamically manage content. Track and get the latest developments on GitHub: https://github.com/xaraya

Java Desktop application capable to "Crawl" a site and return a report of the status of all the link present at the page, then it moves to another internal page and so on. LinkCrawlers provides a nice HTML5 report with the information of all link per WebPage, Easy to Read. This tool is useful for Web QA testers

InSite is a Web site management tool written in perl. It checks link integrity and does some basic content monitoring of your site's files directly on the local disk, which gives it a huge speed advantage over similar tools.

A Java implementation of a flexible and extensible web spider engine. Optional modules allow functionality to be added (searching dead links, testing the performance and scalability of a site, creating a sitemap, etc ..

Checkbot is a tool to verify links on a set of HTML pages. Checkbot can check a single document, or a set of documents on one or more servers. Checkbot creates a report which summarizes all links which caused some kind of warning or error.

massdns reads a list of numeric IP addresses and converts them to a domain name using reverse DNS.

404SEF is a component for Mambo CMS (4.5.x right now, 4.6.x soon) to provide Human Readable URLs. Works with apache and IIS. Provides proper 404 status code for missing content, logs 404 errors, and user-defined custom redirection via special shortcuts

Hostmon is a latency monitoring web app designed for ISP Support Technicians. Hostmon enables the Support Technician to provide a more rounded and detailed oriented service to his/her customers. Hostmon gives the Technician the ability to constantly monitor the network latency to hundreds of customer devices simultaneously. The Technician now has available, not only up to the minute network latency graphs for each device, but they can also view the historic latency information for monitored devices up to a year in the past. Hostmons note system lets multiple Technicians share up to the minute diagnostic information deciphered about each customer device enabling a collaborative diagnostic environment that allows customer facing issues to be identified and solved, quickly. Hostmons alert system will audibly notify the Technician immediately of any network issues causing downtime for the monitored customer devices, enabling the Technician to more effectively multi-task.

osSeo is a SEO (Search Engine Optimization) web tool which provides graphical statistics on the position of a website over the time. It consists on a single WAR file ready to be deployed on any Java application server.

More than just a link checker, sitecheck is a website spider (also known as a crawler) which can assist with SEO by testing an entire site plus both inbound links from search engines and outbound links to other sites for the following issues: looping redirects (HTTP 301/302), broken links (HTTP 404), server errors (HTTP 500), spelling mistakes, low readability scores (using the Flesch Reading Ease test), missing/empty/duplicate meta tags, duplicate content, slow page speed, W3C validation errors and accessibility errors. Sitecheck can also spot some common causes of PCI compliance failure such as insecure content on secure pages, SQL injection/cross-site scripting (XSS) vulnerabilities, insecure encryption ciphers and open mail relays. Sources of information leakage such as email addresses and IP addresses in the headers or the page will be logged. Includes a separate module called domaincheck which checks the domain expiry date, SSL certificate expiry date and SPF records.

To use it just go to https://www.alidoom.host This tool help people to check apple device fmi lock status (icloud activation lock) before buying it, just type device serial number or IMEI and you are done, enjoy it.

CCTE is a CGI Test Enviroment. It's inteded to provided an automated tool for testing web applications.

Programmable web client utilising HttpUnit with input & output files in XML. Eccles includes the ability to create a GUI to control/monitor the processing, and can be used for website testing as well as automating web transactions.

HyperSpider (Java app) collects the link structure of a website. Data import/export from/to database and CSV-files. Export to Graphviz DOT, Resource Description Framework (RDF/DC), XML Topic Maps (XTM), Prolog, HTML. Visualization as hierarchy and map.

JoBo is a web site mirroring tool. It has a graphical UI but there is a also command line version. Supports robot exclusion protocol (but this can be disabled)

LittleLink Custom is an open source self-hosted alternative to services like Linktree and many.link. LittleLink Custom allows you to link all your social media platforms easily accessible on one page. No coding or command line knowledge required. Just easy plug and play.

RoboWeb is set of tools to automate the creation of test suites for any kind of web sites and web applications. RoboWeb uses a proxy recorder to capture user actions as she navigates a site, which later can be reproduced automatically. Site responses