Search Results for "python web crawler"

Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies. Platform-independent, it can retrieve data from both the IMDb's web server and a local copy of the whole db.

Wapiti is a vulnerability scanner for web applications. It currently search vulnerabilities like XSS, SQL and XPath injections, file inclusions, command execution, XXE injections, CRLF injections, Server Side Request Forgery, Open Redirects... It use the Python 3 programming language.

Renders and aggregates other web services into static HTML monitoring output. Also implements simple and dynamic testing of web based applications using mechanize. Includes Basic authentication, and ADFS authentication for web service testing. Custom authentications can be implemented very easily with python programming. Implements PhantomJS rendering for Javascript/HTML5 dynamic web pages.

A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl and index any web or enterprise domain and is configurable through a XML configuration file.

Cutplace validates tabular data (CSV, fixed format) according to an interface control document (ICD). The ICD acts as executable specification and can be described using popular spreadsheet applications (Calc, Excel).

More than just a link checker, sitecheck is a website spider (also known as a crawler) which can assist with SEO by testing an entire site plus both inbound links from search engines and outbound links to other sites for the following issues: looping redirects (HTTP 301/302), broken links (HTTP 404), server errors (HTTP 500), spelling mistakes, low readability scores (using the Flesch Reading Ease test), missing/empty/duplicate meta tags, duplicate content, slow page speed, W3C validation...

Modern software systems and application are commonly written in multiple languages, include scripting engines, and are frequently build on multiple specialized frameworks and middleware for a considerable diversity of runtime environments. The latest influencing update in development paradigm is the application of multicore processors. This projects is aimed to unify the required trace and logging output and integrate into debugging environments. The target is to provide general development,...

Analysis tools for scale test data generated by The Grinder.

ETICS stands for "eInfrastructure for Testing, Integration and Configuration of Software". It provides software professionals with an "out-of-the-box" build and test system, powered with a build and test product repository.

TestFarm is a client-server Python app that allows monitoring the stability and efficiency of a devel project by performing continuous builds and tests in multiple platforms. The overall idea is based on Tinderbox. With a simpler and extensible approach.

Python test runner, initial plan is a main process dispatching test to sub process.

"Yet Another Do-It-Yourself (Test) Automation Framework" specification. Use or modify one of the existing software implementations (hosted/referenced here), or implement the framework yourself. Download and read the spec for more details.

Fressia Project is an effort to develop an Open Source general framework for Testing Automation. It's intended for users (testers) that want a simple tool which can be used just out of the box. It's does not requires any complicated configuration stuff

Browsershots is a system for capturing screenshots of Web pages in many different browsers. When a user submits a web address on the central web interface, the screenshots are made automatically on distributed computers that are run by volunteers.

Addanc is a distributed/scalable system for stress/load testing web based applications. Addanc tests focus on the arrival rate of service requests rather than a fixed number of simulated clients.

Libverticale's mission is to provide semantic web services for an artists center.

collection good tip code as utility packet,esp. Chinses! and design one mail core Blog system. only through mail we can blogging us Blog! and as one opening proj. , let China Python easy share tip code into uniform packet; and enjoy OpenSource...

An unit testing framework (http://www.xprogramming.com/software.htm) to allow unit testing of Products in a real Zope environment, with all the bells and whistles.

OpenLC is a set tools designed to facilitate benchmarking and stress testing of a wide variety of information servers (WEB, Email, FTP, LDAP, ...). A XML-RPC API is offered for developers interested in creating clients that query the services provid

Armstrong is an integrated package for developing web applications in the python web-framework Django.

Performance and load testing framework. We aim to create a testing tool for web applications that can simulate large numbers of concurrent users without mucking around with threads, and thus allow us to perform rate-based testing.