Alternatives to TestNG
Compare TestNG alternatives for your business or organization using the curated list below. SourceForge ranks the best alternatives to TestNG in 2024. Compare features, ratings, user reviews, pricing, and more from TestNG competitors and alternatives in order to make an informed decision for your business.
-
1
Sahi Pro
Tyto Software Pvt Ltd
Sahi Pro is a suite of automation tools for web, web services, Windows desktop, Java and mobile applications. With features like automatic waits, recorders, accessor spy, inbuilt framework and editor, parallel and distributed playback, automatic logging and reporting, javascript code coverage, multi-language support etc., Sahi Pro saves 70% of time and effort normally spent in test automation. Sahi Pro is trusted by over 400 companies worldwide and is fast emerging as the preferred test automation tool in the agile world. Simple to use and easy to learn. Tester-centric while being business-driven. A Test Automation Platform that truly understands your business needs. Sahi Pro is the perfect test automation platform for rockstar QA engineers working on almost any tech stack. Agile quality assurance delivered. Rapid stable playback with continuous Integration for quick feedback. -
2
aqua cloud
aqua cloud GmbH
aqua is an AI-powered advanced Test Management System designed to make the QA process painless. It is ideal for enterprises and SMBs across various sectors, although aqua was initially designed specifically for regulated industries like Fintech, MedTech and GovTech. aqua cloud helps to: - Organize custom testing processes and workflows, - Run testing scenarios of any complexity and scale, - Create extended sets of test data, - Ensure thorough insights with rich reporting capabilities and - Go from manual to automated testing smoothly. Additionally, it includes a unique feature called “Capture," which transforms the process of documenting and reproducing bugs into a 1-click action. aqua integrates with all the most popular issue trackers and automation tools like JIRA, Selenium, Jenkins and others. REST API is also available. aqua's streamlines testing and saves your QA team up to 70% of time, enabling you to deliver high-quality software and releases x2 faster! -
3
Boozang
Boozang
Build. Test. Automate. Empower your whole team to build and maintain automated tests, not just developers. Meet your testing demands fast. Get full test coverage in days, not months. Our natural-language tests are extremely stable to code changes. When tests break our AI will repair it in minutes. Go Agile/DevOps by setting up Continuous Testing. Push features in production the same day. Boozang supports the following test approaches: - Codeless Record/Replay interface - BDD / Cucumber - API testing - Model-based testing - HTML Canvas testing The following features makes your testing a breeze - In-browser console debugging - Screenshots to show where test fails - Integrate to any CI server - Test with unlimited parallel workers to speed up tests - Root-cause analysis reports - Trend reports to track failures and performance over time - Test management integration (Xray / Jira) -
4
Parasoft
Parasoft
Parasoft helps organizations continuously deliver high-quality software with its AI-powered software testing platform and automated test solutions. Supporting embedded and enterprise markets, Parasoft’s proven technologies reduce the time, effort, and cost of delivering secure, reliable, and compliant software by integrating everything from deep code analysis and unit testing to UI and API testing, plus service virtualization and complete code coverage, into the delivery pipeline. A powerful unified C and C++ test automation solution for static analysis, unit testing and structural code coverage, Parasoft C/C++test helps satisfy compliance with industry functional safety and security requirements for embedded software systems. -
5
BrowserStack
BrowserStack
BrowserStack is the world’s largest cloud platform for software testing, with 19 global data centers & 20,000+ real Android and iOS devices that power nearly 1 Billion tests a year. BrowserStack's end-to-end unified testing platform is focused on supporting all genres of testing & operations, from functional testing to visual testing, accessibility testing, performance testing, test observability, API testing, and more. Over 50,000 customers, including Amazon, Paypal, Well Fargo Bank, Nvidia, MongoDB, Pfizer, GE, Discovery, React JS, Apache, JQuery and several others rely on BrowserStack to test their web & mobile apps. -
6
Testim
Tricentis
Testim is the fastest path to resilient end-to-end tests—codeless, coded or both. Testim lets you create amazingly stable codeless tests that leverage our AI, but also the flexibility to export tests as code. You can leverage Testim’s modern JavaScript API and your IDE to debug, customize or refactor tests. Store them in your version control system to keep them in sync with branches and run tests on every commit. Run parallel, cross-browser tests on our test cloud or Selenium-compatible grids while integrating with your CI and dev tools to run smoke tests on pull requests, end-to-end tests on release candidates, or full regression suites on a schedule. Customers like Microsoft, Salesforce, NetApp, Wix, and JFrog run millions of tests on Testim each month. Learn more on our website and sign up for your free account!Starting Price: $450/month -
7
T-Plan Robot
T-Plan
T-Plan Robot automates scripted user actions for Test Automation or Robotic Process Automation (RPA) on Mac, Windows Linux & Mobile. T-Plan develops and sells two main toolsets. 1) Test Automation and 2) Robotic Process Automation (RPA). T-Plan Robot is a highly flexible, easy to use, image-based black box GUI automation tool that creates robust automated scripts and exercises applications in the same way as would an end-user. T-Plan Robot is platform-independent (Java) and runs on, and automates all major systems such as Windows, Mac, Linux and Unix plus mobile platforms. We believe we have a solution for any environment. GUI automation interacts with your business sponsor and development teams throughout the whole project lifecycle. Working intuitively at the screen level business analysts can help testers drive testable paths through the application, whilst at the same time combining with the development team to define repeatable actions to test code in continuous development.Starting Price: $400/month/user -
8
Cucumber
SmartBear
Validate executable specifications against your code on any modern development stack. With over 40 million downloads, Cucumber Open is the world’s #1 automation tool for Behavior-Driven Development. Cucumber Open isn't just open source, it's an open platform that plays well with the tools you already use and love. Works with Java, JavaScript, Ruby, .NET and many other platforms. Store plain text specifications alongside your code in your own source control system. Describe how the system should behave in a way that everybody can understand. Automate with Selenium, API calls or direct function calls in the same process. Generate reports in HTML, JSON and other formats, or build your own reports. Integrate with CucumberStudio, JIRA or build your own plugins. Bridge the gap between business and development using BDD. Decrease rework with test automation. Get real-time insights with living documentation. Seamless integration with Git. -
9
JUnit
JUnit
JUnit 5 is the next generation of JUnit. The goal is to create an up-to-date foundation for developer-side testing on the JVM. This includes focusing on Java 8 and above, as well as enabling many different styles of testing. We ask you – our users – to support us so we can keep up the pace. We will continue our work on JUnit regardless of how many donations we receive. However, your support would enable us to do so with greater focus and not only on weekends or in our spare time. For example, we want to meet regularly and work colocated for a few days in order to get things done faster in face-to-face design and coding sessions. Your donations will help to make that a reality! -
10
pytest
pytest
pytest helps you write better programs. The pytest framework makes it easy to write small tests, yet scales to support complex functional testing for applications and libraries. Due to pytest’s detailed assertion introspection, only plain assert statements are used. Detailed info on failing assert statements. Auto-discovery of test modules and functions. Modular fixtures for managing small or parametrized long-lived test resources. Can run unittest (including trial) and nose test suites out of the box. Supports Python 3.6+ and PyPy 3. Rich plugin architecture, with over 315+ external plugins and thriving community. The maintainers of pytest and thousands of other packages are working with Tidelift to deliver commercial support and maintenance for the open source dependencies you use to build your applications. Save time, reduce risk, and improve code health, while paying the maintainers of the exact dependencies you use. -
11
TestComplete
SmartBear
Ensure the quality of your application without sacrificing speed or agility with an easy-to-use, GUI test automation tool. Our AI-powered object recognition engine and script or scriptless flexibility is unmatched, letting you test every desktop, web, and mobile application with ease. TestComplete comes with an intelligent object repository and support for over 500 controls, so you can ensure your GUI tests are scalable, robust, and easy to maintain. More automated quality means more overall quality. Automate UI testing across a wide range of desktop applications, including .Net, Java, WPF and Windows 10. Create reusable tests for all web applications including modern JavaScript frameworks like React and Angular on 2050+ browser and platform configurations. Create and automate functional UI tests on physical or virtual iOS and Android devices. No need to jailbreak your phone.Starting Price: $4,836 -
12
Ranorex Studio
Ranorex
Empower everyone on the team to perform robust automated testing on desktop, web and mobile applications, regardless of their experience with functional test automation tools. Ranorex Studio is an all-in-one solution that includes tools for codeless automation as well as a full IDE. With our industry-leading object recognition and shareable object repository, Ranorex Studio makes it possible to automate GUI testing for even the most challenging interfaces, from legacy applications to the latest web and mobile technologies. Ranorex Studio supports cross-browser testing with built-in Selenium WebDriver integration. Perform effortless data-driven testing using CSV files, Excel spreadsheets or SQL database files as input. Ranorex Studio also supports keyword-driven testing: our tools for collaboration allow test automation engineers to build reusable code modules and share them with the team. Download our free 30-day trial for a risk-free start to test automation.Starting Price: $3,590 for single-user license -
13
AgitarOne
Agitar Technologies
The AgitarOne product family helps you work safer, better, and smarter as you develop and maintain your Java applications. AgitarOne JUnit Generator creates thorough JUnit tests on your code. This helps you find regressions and makes it safer and easier to improve your code to reduce the cost to maintain it. AgitarOne Agitator helps developers understand the behavior of their code as they write it. This helps you prevent bugs and prevent code complexity that can become tomorrow's maintenance headache. The AgitarOne family is the best available way to create, use, and manage the unit tests that you need to be truly agile. Automated JUnit Generation, you can automate the generation of JUnit tests to create a "safety net" before you start working with existing code. You can automate the generation of JUnit tests to create a "safety net" before you start working with existing code. -
14
Typemock
Typemock
The easiest way to unit test. Write tests without changing your code! Even legacy code. Static methods, private methods, non-virtual methods, out parameters and even members and fields. Our professional edition is free for developers around the world. We also have paid support package. Improve your code integrity and deliver quality code. Fake entire object models with a single statement. Mock statics, private, constructors, events, linq, ref args, live, future, static constructors. Our suggest feature creates automated test suggestions suitable for your code. Our smart runner will run only your impact tests and get you super fast feedback. Our coverage feature displays your code coverage in your editor while you code.Starting Price: $479 per license per year -
15
Klaros-Testmanagement
verit Informationssysteme GmbH
Klaros-Testmanagement is a proven and popular tool from Germany which is developed since 2009 and used worldwide by large and small teams to plan and execute their testing activities. The functional scope covers all areas of the test process: test planning, test creation, test execution, assignment and evaluation of test tasks as well as test evaluation and report creation. Interfaces to defect and requirements management systems, continuous integration, test automation and performance analysis exist for numerous tools such as JIRA, Redmine, GitLab, GitHub, Jenkins, JMeter, QF-Test, Selenium, JUnit, QTP, and many more. The software is available as a free Community Edition and an Enterprise Edition with comprehensive support, both as a server installation and as a cloud service.Starting Price: $30 per user/month -
16
JMockit
JMockit
The toolkit is provided as a set of artifacts deployed to the Maven Central repository. It requires Java 7 or newer for test execution; tests must use JUnit or TestNG. For instructions on how to add the library to a Java project, see Running tests with JMockit. In this tutorial we examine the APIs available in the library, with the help of example tests (using Java 8). The central API - a single annotation - provides support for the automatic instantiation and initialization of the objects to be tested. Then we have the mocking API (also known as the "Expectations" API), intended for tests which use mocked dependencies. Finally, there is a small faking API (aka the "Mockups" API), which can be used for the creation and application of fake implementations that avoid the full cost of external components.Starting Price: Free -
17
dotCover
JetBrains
dotCover is a .NET unit testing and code coverage tool that works right in Visual Studio and in JetBrains Rider, helps you know to what extent your code is covered with unit tests, provides great ways to visualize code coverage, and is Continuous Integration ready. dotCover calculates and reports statement-level code coverage in applications targeting .NET Framework, .NET Core, Mono for Unity, etc. dotCover is a plug-in to Visual Studio and JetBrains Rider, giving you the advantage of analyzing and visualizing code coverage without leaving the code editor. This includes running unit tests and analyzing coverage results right in the IDEs, as well as support for different color themes, new icons and menus. dotCover comes bundled with a unit test runner that it shares with another JetBrains tool for .NET developers, ReSharper. dotCover supports continuous testing, a modern unit testing workflow whereby dotCover figures out on-the-fly which unit tests are affected by your code changes.Starting Price: $399 per user per year -
18
NUnit
.NET Foundation
NUnit is a unit-testing framework for all .Net languages. Initially ported from JUnit, the current production release, version 3, has been completely rewritten with many new features and support for a wide range of .NET platforms. The NUnit Project is a member of the .NET Foundation. The .NET Foundation will provide guidance and support to help ensure the future of the project. The success of NUnit has been made possible through the hard work of our many contributors and team members. The Core Team thanks everyone for the help and contributions that have made NUnit the success that it is. At last count, the various NUnit packages passed 126 million downloads on NuGet.org. We couldn't have done that without the dedication of the many volunteers that donate their time and knowledge to the project. NUnit is Open Source software and NUnit 3 is released under the MIT license. -
19
API testing, functional UI testing, performance testing and service virtualization. IBM Rational Test Workbench provides software testing tools to support a DevOps approach: API testing, functional UI testing, performance testing and service virtualization. It helps you automate and run tests earlier and more frequently to discover errors sooner—when they are less costly to fix. IBM also provides a new bundled offering under a new consumption model that changes the way you can use and deploy DevOps software. The new offering helps simplify your planning for adoption and growth of critical IBM DevOps products. Automate all types of tests -- traditional functional/regression, mobile and integration technology, performance and scalability. Fully-integrated authoring environment provides a consistent user experience across a variety of domains. Don't wait for everything to be available to start testing, create virtual components and start testing right away.
-
20
HUnit
Hackage
HUnit is a unit testing framework for Haskell, inspired by the JUnit tool for Java. It's easy to use HUnit, assuming you are familiar with Haskell, though not necessarily with JUnit. A test-centered methodology for software development is most effective when tests are easy to create, change, and execute. The JUnit tool pioneered support for test-first development in Java. HUnit is an adaptation of JUnit to Haskell, a general-purpose, purely functional programming language. With HUnit, as with JUnit, you can easily create tests, name them, group them into suites, and execute them, with the framework checking the results automatically. Test specification in HUnit is even more concise and flexible than in JUnit, thanks to the nature of the Haskell language. HUnit currently includes only a text-based test controller, but the framework is designed for easy extension. Run the tests as a group.Starting Price: Free -
21
HCL OneTest
HCL Technologies
HCL OneTest provides software testing tools to support a DevOps approach: API testing, functional testing, UI testing, performance testing and service virtualization. It helps you automate and run tests earlier and more frequently to discover errors sooner — when they are less costly to fix. HCL also provides a bundled offering under a new consumption model that changes the way you can use and deploy DevOps software. The new offering helps simplify your planning for adoption and growth of critical DevOps products. HCL OneTest UI enables testers to take automation all the way from mainframe terminals with 3270 interfaces, through .NET- and Java-based thick client applications. Additionally, it works with the latest top browsers, ERP systems such as SAP and Oracle, right up to HTML5-based responsive web applications that are built on modern frameworks like Angular, React and Vue.js. -
22
ReadyAPI
SmartBear
The ReadyAPI platform accelerates functional, security, and load testing of RESTful, SOAP, GraphQL and other web services right inside your CI/CD pipeline. ReadyAPI allows teams to create, manage, and execute automated functional, security, and performance tests in one centralized interface - accelerating API quality for Agile and DevOps software teams. Teams can get started by importing API definitions like OAS (Swagger) or WSDLs, testing and recording live API traffic, or virtualizing web services to remove pipeline dependencies. Create comprehensive, data-driven functional API tests without the hassle of maintaining scripts. Generate load, stress, and spike tests to validate whether your API can handle real-world traffic conditions. Secure your vulnerable APIs from XSS, malformed XML, SQL injections and more with each deployment. Remove dependencies in your testing pipeline by virtualizing RESTful, SOAP, TCP, JMS, and other web services.Starting Price: $644 per year -
23
Appvance
Appvance.ai
Appvance IQ (AIQ) delivers transformational productivity gains and lower costs in both test creation and execution. For test creation, it offers both AI-driven (fully machine-generated tests) and also 3rd-generation, codeless scripting. It then executes those scripts through data-driven functional, performance, app-pen and API testing — for both web and mobile apps. AIQ’s self-healing technology gives you complete code coverage with just 10% the effort of traditional testing systems. Most importantly, AIQ finds important bugs autonomously, with little effort. No coding, scripting, logs or recording required. AIQ is easy to integrate with your current DevOps tools and processes. Appvance IQ was developed by a pioneering team who envisioned a better way to test. Their innovative vision has been made possible by applying differentiated, patented AI methods to test creation while leveraging today’s high-availability compute resources for massive levels of parallel execution. -
24
Screenster
Screenster
As you interact with a web page Screenster records your actions. No coding, no element ids, no adding checks and assertions. Rerun recorded test and let Screenster optimize it. Parameters are automatically extracted and self-healing selectors stored for all actions. Approve intended changes to the baseline and update the default state of the UI. Exclude one or several UI elements from comparison. No browser plugins, no desktop installs, no manuals to read. Just type a URL to a Screenster server and enjoy the ride. Screenster can intelligently detect visual and content changes. It has sophisticated algorithms that compare run results to the baseline and find new, deleted and changed content. Screenster smart selectors automatically locate moved and changed page elements. It discovers and adjusts timeouts and uses AI to wait for the right time to move to the next step. You can run your tests on our cloud, or download Screenster Server and install it on-prem.Starting Price: $100.00/month/user -
25
PHPUnit
PHPUnit
PHPUnit requires the dom and json extensions, which are normally enabled by default. PHPUnit also requires the pcre, reflection, and spl extensions. These standard extensions are enabled by default and cannot be disabled without patching PHP’s build system and/or C sources. The code coverage report feature requires the Xdebug (2.7.0 or later) and tokenizer extensions. Generating XML reports requires the xmlwriter extension. Unit Tests are primarily written as a good practice to help developers identify and fix bugs, to refactor code and to serve as documentation for a unit of software under test. To achieve these benefits, unit tests ideally should cover all the possible paths in a program. One unit test usually covers one specific path in one function or method. However a test method is not necessarily an encapsulated, independent entity. Often there are implicit dependencies between test methods, hidden in the implementation scenario of a test.Starting Price: Free -
26
Cantata
QA Systems
Cantata is a unit and integration testing tool, enabling developers to verify standard compliant or business critical code on host native and embedded target platforms. Cantata helps accelerate compliance with the standard’s dynamic testing requirements by automating test framework generation, test execution. results diagnostics and report generation. Cantata is integrated with an extensive set of embedded development toolchains, from compilers and static analysis tools to build and requirements management tools. The ECLIPSE® GUI, tight tool integrations and tests written in the source C/C++ code, all make Cantata easy to use. Cantata has been independently certified by SGS-TÜV SAAR GmbH for the main software safety standards. Standard specific Cantata tool certification kits are provided free of charge and contain everything needed out-of-the-box as well as comprehensive guidance to help you achieve certification for your device software. -
27
Embunit
Embunit
Embunit is a unit testing tool for programmers and testers developing software in C or C++. It is aimed at embedded software development, but can be used to create unit tests for any software written in C or C++. Embunit eliminates the mundane, repetitive aspects of writing unit tests, leaving you free to concentrate on defining the test behaviour. This is achieved by specifying a sequence of actions as shown in the example screenshot below. Embunit generates the unit test source code automatically. Embunit has been developed with flexibility in mind, and can be customised to create unit tests for virtually any hardware platform; even the smallest microcontrollers. It is not tied to any specific toolset and is designed to accommodate the common limitations of embedded C++ compilers.Starting Price: $131.19 per user -
28
TestBench for IBM i
Original Software
Testing and test data management for IBM i, IBM iSeries, AS/400. Complex IBM i applications must be checked from top to bottom, right into the data, wherever it is. TestBench IBM i is a comprehensive, proven test data management, verification and unit testing solution that integrates with other solutions for total application quality. Stop copying the entire live database and hone in on the data you really need. Select or sample data with full referential integrity preserved. Simply decide which fields need to be protected and use a variety of obfuscation methods to protect your data. Track every insert, update and delete including intervening data states. Create rules so that data failures are flagged to you automatically. Avoid the painful save/restores and stop attempting to explain bad test results based on poor initial data. Comparing outputs is a well proven method to verify your test results but it can be laborious and prone to error. This unique solution can save hours.Starting Price: $1,200 per user per year -
29
WireMock
WireMock
WireMock is a simulator for HTTP-based APIs. Some might consider it a service virtualization tool or a mock server. It enables you to stay productive when an API you depend on doesn't exist or isn't complete. It supports testing of edge cases and failure modes that the real API won't reliably produce. And because it's fast it can reduce your build time from hours down to minutes. MockLab is a hosted API simulator built on WireMock, with an intuitive web UI, team collaboration and nothing to install. The 100% compatible API supports drop-in replacement of the WireMock server with a single line of code. Run WireMock from within your Java application, JUnit test, Servlet container or as a standalone process. Match request URLs, methods, headers cookies and bodies using a wide variety of strategies. First class support for JSON and XML. Get up and running quickly by capturing traffic to and from an existing API. -
30
Nightwatch.js
Nightwatch.js
Nightwatch.js is an integrated, easy to use End-to-End testing solution for web applications and websites, written in Node.js. It uses the W3C WebDriver API to drive browsers and perform commands and assertions on DOM elements. Simple but powerful syntax which enables you to write tests very quickly, using Javascript (Node.js) and CSS or Xpath selectors. Typescript is supported as well. Built-in command-line test runner which runs the tests either sequentially or in parallel, with retries and implicit waits. Also supports grouping of test suites and tags. Manages automatically Selenium or WebDriver services (ChromeDriver, GeckoDriver, Edge, Safari) in a separate child process. Fluent and easy to work with Page Object Model support to better organise elements and sections, with support for both CSS or Xpath selectors.Starting Price: Free -
31
Playwright
Playwright
Playwright supports all modern rendering engines including Chromium, WebKit, and Firefox. Test on Windows, Linux, and macOS, locally or on CI, headless or headed. Playwright waits for elements to be actionable prior to performing actions. It also has a rich set of introspection events. The combination of the two eliminates the need for artificial timeouts - the primary cause of flaky tests. Playwright assertions are created specifically for the dynamic web. Checks are automatically retried until the necessary conditions are met. Configure test retry strategy, capture execution trace, videos, screenshots to eliminate flakes. Browsers run web content belonging to different origins in different processes. Playwright is aligned with the modern browsers architecture and runs tests out-of-process. This makes Playwright free of the typical in-process test runner limitations.Starting Price: Free -
32
LDRA Tool Suite
LDRA
The LDRA tool suite is LDRA’s flagship platform that delivers open and extensible solutions for building quality into software from requirements through to deployment. The tool suite provides a continuum of capabilities including requirements traceability, test management, coding standards compliance, code quality review, code coverage analysis, data-flow and control-flow analysis, unit/integration/target testing, and certification and regulatory support. The core components of the tool suite are available in several configurations that align with common software development needs. A comprehensive set of add-on capabilities are available to tailor the solution for any project. LDRA Testbed together with TBvision provide the foundational static and dynamic analysis engine, and a visualization engine to easily understand and navigate standards compliance, quality metrics, and code coverage analyses. -
33
OpenText UFT One
OpenText
Accelerate test automation with one intelligent functional testing tool for web, mobile, API and enterprise apps. Intelligent test automation with embedded AI-based capabilities that accelerates testing across desktop, web, mobile, mainframe, composite and packaged enterprise-grade apps. Automate and accelerate the end-to-end testing of 200+ enterprise apps, technologies and environments with a single intelligent testing tool. AI-powered intelligent test automation reduces functional test creation time and maintenance while boosting test coverage and resiliency. Test both the front-end functionality and back-end service parts of an application to increase test coverage across the UI and API. Test more in less time and achieve test execution at full velocity with parallel testing, cross-browser coverage, and cloud-based deployment. -
34
TAST
SIPSA
TAST, Test Automation System Tool is a comprehensive cloud test automation framework that enables businesses to maximize their test automation across the complete testing process from an End User´s perspective. It is easy to use and its graphical interface defines the automated test cases across technological platforms. TAST automates: *Cross Browser testing *Mobile testing *Desktop applications testing *DDBB testing: Oracle, PostgreSQL, MySQL, Db2. *File testing: txt, pdf, word, excel, csv, xml. *Mainframe testing: AS400, Host *APIs testing *Interface testing. *Remote Server testing. Types of tests you can automate with TAST: *Integration *Functional *System: Regressive, stress, load, parallel *Acceptance *A/B. -
35
OpenText Functional Test Automation
OpenText
Functional test automation for web, mobile, rich-client, and enterprise applications. Collaborative test design enables business and technical stakeholders to work together to ensure a full range of test coverage. Ensure quality and accelerate testing on any device and platform, across web, mobile, rich-client, and enterprise apps. Leverage existing Selenium scripts and record additional steps in Silk Test for desktop and mobile browsers. Integrate functional testing into the CI/CD pipeline with parallel and dockerized testing to provide prompt feedback on daily check-ins. Conduct cross-platform testing and create a single test script to test against IE, Edge, Firefox, Chrome, Safari, and mobile browsers. Create realistic simulations of service behavior while saving time and effort with embedded back-end service virtualization. Collaborative test design enables business and technical stakeholders to work together to ensure test coverage for a full range of customer usage patterns. -
36
JMeter
Apache Software Foundation
The Apache JMeter™ application is open source software, a 100% pure Java application designed to load test functional behavior and measure performance. It was originally designed for testing Web Applications but has since expanded to other test functions. Apache JMeter may be used to test performance both on static and dynamic resources, Web dynamic applications. It can be used to simulate a heavy load on a server, group of servers, network or object to test its strength or to analyze overall performance under different load types. -
37
Tosca
Tricentis
No-code, Automated Continuous Testing. Tricentis Tosca, the #1 Continuous Testing platform, accelerates testing with a script-less, no-code approach for end-to-end test automation. With support for over 160+ technologies and enterprise applications, Tosca provides resilient test automation for any use case. Learn how Tricentis Tosca can help you: - Deliver fast feedback for Agile and DevOps - Reduce regression testing time to minutes - Maximize reuse and maintainability - Gain clear insight into business risk - Integrate and extend existing test assets (HPE UFT, Selenium, SoapUI…) -
38
Ranorex DesignWise
Ranorex
Building high-quality, automated tests is a critical part of ensuring that software is well-optimized and polished before release. But it can also be time-consuming for programmers to build numerous tests to catch as many bugs as they can. Ranorex’s DesignWise software can refocus your test building to reduce test cycles, save money, and get your product out the door faster. DesignWise includes a collection of Intelligent Augmentation algorithms and a “control dial” that makes it easy for test developers to create the right number of tests for their project. Users can remove unnecessary variables and only focus on the parameters that they need. This enables team members to find and fill gaps in their test coverage and spot areas where tests are unnecessarily or overlapping and eliminate them. -
39
AWS Device Farm
Amazon
AWS Device Farm is an application testing service that lets you improve the quality of your web and mobile apps by testing them across an extensive range of desktop browsers and real mobile devices; without having to provision and manage any testing infrastructure. The service enables you to run your tests concurrently on multiple desktop browsers or real devices to speed up the execution of your test suite, and generates videos and logs to help you quickly identify issues with your app. Test your app in parallel against a massive collection of physical devices in the AWS Cloud. Use one of our built-in frameworks, to test your applications without having to write or maintain test scripts, or use one of our supported automation testing frameworks. Gesture, swipe, and interact with devices in real time, directly from your web browser. Run your Selenium tests in parallel on multiple versions of Chrome, Internet Explorer, and Firefox, that are hosted in the AWS Cloud. -
40
Alithya GoTest
Alithya
Alithya GoTest is a collaborative test hub that is easy and quick to master and integrate, ensuring the quality of any professional digital solutions for companies requiring reliability without compromises. Ensure the quality of your application without sacrificing speed or agility with an easy-to-use, GUI test automation tool. Whether using scripts or not, our flexibility is unmatched, letting you create manual, automated or hybrid test suites for every desktop, web, and mobile application with ease including .Net, Java, WPF and Windows 10, modern JavaScript frameworks like React and Angular and iOS or Andoid with 2050+ browser and platform configurations. No need to jailbreak your devices. Alithya GoTest comes with a keyword library of over 1500 keywords, so you can ensure your GUI and API tests are scalable, robust, and easy to maintain. Alithya also offers consulting, coaching and training to ensure the success of your teams. -
41
OpenText LoadRunner Professional
OpenText
OpenText™ LoadRunner™ Professional simplifies performance load testing for co-located teams. With project-based capabilities, your teams can quickly identify abnormal application behavior. Supports performance testing for the widest range of protocols and 50+ technologies and application environments. Quickly identify the most likely causes of performance issues with a patented auto-correlation engine. Accurately predict application scalability and capacity with accurate emulation of realistic loads. Centralized project testing allows high-scale tests to run using minimal hardware and seamlessly leverage the public cloud to scale up and down. -
42
Visual Studio App Center
Microsoft
Continuously build, test, release, and monitor apps for every platform. Connect to GitHub, Bitbucket, GitLab, or Azure DevOps and build your app in the cloud on every commit. Automatically run unit tests, release to testers and stores, or test your UI on real devices. Commit to a feature branch to build and test. Commit to a beta branch to distribute to testers. Commit to master to submit to the App Store. Customize to fit your team’s workflow. Does your app still work after your latest change? How does it perform on an LG G2? Find out by testing your app in a hosted device lab with 1000s of real iOS and Android devices. You’ll receive test results, full-resolution screenshots of every step, along with performance metrics. Whether you prefer private distribution, public open betas, Microsoft Intune, TestFlight, Google Play, or the App Store, App Center makes releasing your app a delight.Starting Price: $40 per month -
43
Selenium
Software Freedom Conservancy
Selenium automates browsers. That's it! What you do with that power is entirely up to you. Primarily it is for automating web applications for testing purposes, but is certainly not limited to just that. Boring web-based administration tasks can (and should) also be automated as well. If you want to create robust, browser-based regression automation suites and tests, scale and distribute scripts across many environments, then you want to use Selenium WebDriver, a collection of language specific bindings to drive a browser - the way it is meant to be driven. If you want to create quick bug reproduction scripts, create scripts to aid in automation-aided exploratory testing, then you want to use Selenium IDE; a Chrome and Firefox add-on that will do simple record-and-playback of interactions with the browser. If you want to scale by distributing and running tests on several machines and manage multiple environments from a central point. -
44
Catch2
Catch2
Catch2 is mainly a unit testing framework for C++, but it also provides basic micro-benchmarking features and simple BDD macros. Catch2's main advantage is that using it is both simple and natural. Test names do not have to be valid identifiers, assertions look like normal C++ boolean expressions, and sections provide a nice and local way to share set-up and tear-down code in tests. You are on the devel branch, where the v3 version is being developed. v3 brings a bunch of significant changes, the big one being that Catch2 is no longer a single-header library. Catch2 now behaves as a normal library, with multiple headers and separately compiled implementation. Quick and easy to get started. Just download two files, add them to your project and you're away. No external dependencies. As long as you can compile C++14 and have the C++ standard library available. Write test cases as, self-registering, functions (or methods, if you prefer).Starting Price: Free -
45
QUnit
QUnit
The powerful, easy-to-use JavaScript testing framework. Easy, zero-configuration setup for any Node.js project and minimal configuration for browser-based projects. Tests can be run anywhere; Node, your browser, even inside a web worker. Test your code where it runs. Flexible APIs for custom assertions, runners, and reporters mean you can extend QUnit to fit your needs. Getting started with QUnit for Node.js projects is quick and easy. First, install the QUnit package using npm. You can now run the test suite through the QUnit CLI. It is recommended that you run the QUnit command via an npm script, which will find the QUnit command automatically from your local dependencies. Check out the API documentation to learn more about the QUnit APIs for organizing tests and making assertions.QUnit follows the Node.js Long-term Support (LTS) schedule and provides support for current, active LTS, and maintenance LTS releases.Starting Price: Free -
46
Jest
Jest
Jest aims to work out of the box, config free, on most JavaScript projects. Make tests which keep track of large objects with ease. Snapshots live either alongside your tests, or embedded inline. Tests are parallelized by running them in their own processes to maximize performance. Tests are parallelized by running them in their own processes to maximize performance. By ensuring your tests have unique global state, Jest can reliably run tests in parallel. To make things quick, Jest runs previously failed tests first and re-organizes runs based on how long test files take. By ensuring your tests have unique global state, Jest can reliably run tests in parallel. To make things quick, Jest runs previously failed tests first and re-organizes runs based on how long test files take. Jest uses a custom resolver for imports in your tests, making it simple to mock any object outside of your test’s scope. -
47
Karma
Karma
The main goal for Karma is to bring a productive testing environment to developers. The environment being one where they don't have to set up loads of configurations, but rather a place where developers can just write the code and get instant feedback from their tests. Because getting quick feedback is what makes you productive and creative. Test your code on real browsers and real devices such as phones, tablets or on a headless PhantomJS instance. Control the whole workflow from the command line or your IDE - just save a file and Karma will run all the tests. Karma also watches all the files, specified within the configuration file, and whenever any file changes, it triggers the test run by sending a signal to the testing server to inform all of the captured browsers to run the test code again. Each browser then loads the source files inside an IFrame, executes the tests and reports the results back to the server.Starting Price: Free -
48
XCTest
Apple
Create and run unit tests, performance tests, and UI tests for your Xcode project. Use the XCTest framework to write unit tests for your Xcode projects that integrate seamlessly with Xcode's testing workflow. Tests assert that certain conditions are satisfied during code execution, and record test failures (with optional messages) if those conditions aren’t satisfied. Tests can also measure the performance of blocks of code to check for performance regressions and can interact with an application's UI to validate user interaction flows. A test method is a small, self-contained method that tests a specific part of your code. A test case is a group of related test methods. Add test cases and test methods to a test target to confirm that your code performs as expected. The primary class for defining test cases, test methods, and performance tests. An abstract base class for creating, managing, and executing tests.Starting Price: Free -
49
EasyMock
EasyMock
Most parts of a software system do not work in isolation, but collaborate with other parts to get their job done. In a lot of cases, we do not care about using real collaborators implementation in unit testing, as we trust these collaborators. Mock objects replace collaborators of the unit under test. To test a unit in isolation or mount a sufficient environment, we have to simulate the collaborators in the test. A Mock Object is a test-oriented replacement for a collaborator. It is configured to simulate the object that it replaces in a simple way. In contrast to a stub, a Mock Object also verifies whether it is used as expected. EasyMock has been the first dynamic Mock Object generator, relieving users of hand-writing Mock Objects, or generating code for them. EasyMock provides Mock Objects by generating them on the fly using Java proxy mechanism. -
50
unittest
Python
The unittest unit testing framework was originally inspired by JUnit and has a similar flavor as major unit testing frameworks in other languages. It supports test automation, sharing of setup and shutdown code for tests, aggregation of tests into collections, and independence of the tests from the reporting framework. A test fixture represents the preparation needed to perform one or more tests, and any associated cleanup actions. This may involve, for example, creating temporary or proxy databases, directories, or starting a server process. A test suite is a collection of test cases, test suites, or both. It is used to aggregate tests that should be executed together. A test runner is a component which orchestrates the execution of tests and provides the outcome to the user. The runner may use a graphical interface, a textual interface, or return a special value to indicate the results of executing the tests.Starting Price: Free