Search Results for "web crawler source code"

More than just a link checker, sitecheck is a website spider (also known as a crawler) which can assist with SEO by testing an entire site plus both inbound links from search engines and outbound links to other sites for the following issues: looping redirects (HTTP 301/302), broken links (HTTP 404), server errors (HTTP 500), spelling mistakes, low readability scores (using the Flesch Reading Ease test), missing/empty/duplicate meta tags, duplicate content, slow page speed, W3C validation...

The web lint checks HTML and XHTML pages for possible markup problems. It attempts to find problems with your code that an HTML validator does not.

Cheetah is a template engine and code generation tool, written in Python. Web development is its principle use, but Cheetah is very flexible and is also being used to generate C++ game code, Java, sql, form emails and even Python code.

Txt2tags converts a text file with minimal markup to HTML, XHTML, SGML, LaTeX, Lout, UNIX Man Page, Wikipedia, Google Code Wiki, DokuWiki, MoinMoin, MagicPoint(mgp), PageMaker. Features: simple, fast, automatic TOC, macros, filters, include, GUI/CLI/

Nanon is a web page manager, ideal for simple sites with no server generated content. It lets you define templates and reusable html code blocks like menus and ad sections. Nanon is a spiffy command line tool that you can learn how to use in minutes.

Up2me allows you to simply upload media to your own hosting provider web space. Thumbnails are automatically generated and you are given the HTML code to add to your site or blog post. Why rely on 3rd party media hosting providers?

This project is an XML oriented Web Framework that relies on python for expansion of XML data into web pages, while keeping code and content sepearted. Coupling this with CSS allows for complete page formatting and styling without touching python code

Not the greatest thing since Sliced Bread, it IS Sliced Bread. This project is a series of network tools and a network development SDK, with big hopes, and too little time to code it all.

Webcomic Archive and News Generator (WANG) is a database driven PHP application built for both aspiring and existing web comics. Written with a focus on security and speed, the code is built to be easy to use for code novices and experts alike.

2tools is a set of online CMS maintenance tools: just one click to migrate to/from different CMS; safe configuration settings to upgrade your CMS; easy Data movement to/from DBMS, databases or tables; SQL, XML, XSLT, PHP technologies. All tools are main

This has a Python ICAP (Internet Content Adaptation Protocol) server and IRML parser. Using this, a web proxy can do rule-based adaptation of content before delivery to clients. Has a Python proxylet API and squid-icap-client code too.

BlueBook.. The Value of Code. A Zope product to provide a code snippet repository. Provides a "learn by example" environment, and cut&paste type code sharing. It is a "cookbook" in which snippets are "Recipes" that contain code and can be rated.

PM2HTML takes PageMaker files and makes a cohesive newspaper website. It comprises a PMScript that exports all stories to a directory of tagged txts, and a python program to act as a converter to turn those tagged text files into HTML, a parser to guess