Recent changes to Home

Home modified by urueda

urueda — Fri, 03 May 2013 16:01:34 -0000

--- v11
+++ v12
@@ -1,3 +1,7 @@
+The FITTEST ITE (Integrated Testing Environment) is a tool for the automated test of Future Internet applications. It integrates a tool suite of new and improved testing tools for continuous automated testing. 
+
+---
+
 General information about the EU FITTEST project:

 * [FITTEST Objectives](Objectives)

Home modified by urueda

urueda — Thu, 18 Apr 2013 15:43:23 -0000

--- v10
+++ v11
@@ -1,9 +1,11 @@
-[FITTEST Objectives](Objectives)
+General information about the EU FITTEST project:

-[FITTEST Contractors](Contractors)
+* [FITTEST Objectives](Objectives)

+* [FITTEST Contractors](Contractors)

+* [FITTEST Global picture](GlobalPic)

-[Work performed and results achieved so far](Status)
+* [Work performed and results achieved so far](Status)

-[Expected end results](Expectations)
+* [Expected end results](Expectations)

Home modified by urueda

urueda — Thu, 18 Apr 2013 15:41:26 -0000

--- v9
+++ v10
@@ -2,29 +2,7 @@

 [FITTEST Contractors](Contractors)

-As the [FITTEST global picture](https://sourceforge.net/p/fittest/wiki/Home/attachment/FITTEST%20GlobalPic%20v3.7.png) shows, the FITTEST ITE for Continuous Testing integrates testing tools developed and/or improved as result of the tasks performed through the work packages 3 to 9 of the FITTEST EU project, including but not limited to:

-* UCL WATT for Coverage testing
-* IBM ConTest for Concurrency testing
-* IBM Focus for Testware generation and Coverage testing
-* B&M CTE for Combinatorial testing
-* FBK TSS for Regression testing
-* FITTEST Continuous Testing Tool
-* GUITEST tool for GUI crash testing
-
-In the global picture, the FITTEST Continuous Testing approach is outlined in more details. It roughly consists of four main stages in a loop (or cycle) as depicted in the picture above. Though the starting point in the cycle depends on the concrete testing scenario and the concrete quality criteria pursued, the typical full-cycle starts instrumenting the System Under Test (SUT). The instrumentation is usually needed for monitoring SUT execution and guiding the testing tasks.
-
-The yellow boxes in the figure represent the evolutionary approach of FITTEST. That is, the FITTEST techniques are optimized when possible to deal with the nature of FI applications, using evolutionary search based software engineering techniques.
-
-The application or System Under Test (SUT) is encapsulated into a Test Case Execution (TCE) environment that enables features of tracing and controlled-execution of the application. The environment consists of instrumentation facilities for the underlying technology and capture-replay utilities that help monitor the test cases generated and executed over the FITTEST cycle.
-
-Three main modules are identified for the TCE environment. The logger feature keeps track of the events (system events, user events, exceptions risen, etc.) during executions of the SUT. The coverage module collects information necessary to measure the degree of testing achieved. The last module runs concurrency tests while the SUT is executed. Three main sources of information come from the TCE environment: logs, coverage and failures/bugs.
-
-The information gathered from the SUT executions is analysed by low-level techniques. For example, from the logged information, FITTEST will do: log diagnosis, model inference and oracle learning. The last one may provide the facility of inferring oracles that predict which SUT executions may be reasonable and may be prone to errors detection. The other two (log diagnosis and model inference) produce artifacts for the next stage in the cycle: testware generation.
-
-The high-level testing techniques (i.e. model-based testing and combinatorial testing) use the artifacts produced to automatically generate abstract test cases. For the combinatorial part, the end-user may interact to adapt the selection of test cases to specific criteria. Mutation testing is another high-level technique that can be used to generate test data using evolutionary test case generation techniques.
-
-The last stage is responsible for compilation of the generated abstract test cases into concrete test cases that the SUT can execute in the context of the TCE. The compilation of the test cases can use oracles learned or other test data generated from evolutionary computations based on the logs, coverage and/or failure information.

 [Work performed and results achieved so far](Status)

Home modified by urueda

urueda — Thu, 18 Apr 2013 09:43:49 -0000

--- v8
+++ v9
@@ -27,3 +27,5 @@
 The last stage is responsible for compilation of the generated abstract test cases into concrete test cases that the SUT can execute in the context of the TCE. The compilation of the test cases can use oracles learned or other test data generated from evolutionary computations based on the logs, coverage and/or failure information.

 [Work performed and results achieved so far](Status)
+
+[Expected end results](Expectations)

Home modified by urueda

urueda — Thu, 18 Apr 2013 09:42:16 -0000

--- v7
+++ v8
@@ -25,3 +25,5 @@
 The high-level testing techniques (i.e. model-based testing and combinatorial testing) use the artifacts produced to automatically generate abstract test cases. For the combinatorial part, the end-user may interact to adapt the selection of test cases to specific criteria. Mutation testing is another high-level technique that can be used to generate test data using evolutionary test case generation techniques.

 The last stage is responsible for compilation of the generated abstract test cases into concrete test cases that the SUT can execute in the context of the TCE. The compilation of the test cases can use oracles learned or other test data generated from evolutionary computations based on the logs, coverage and/or failure information.
+
+[Work performed and results achieved so far](Status)

Home modified by urueda

urueda — Wed, 17 Apr 2013 18:08:37 -0000

--- v6
+++ v7
@@ -2,7 +2,7 @@

 [FITTEST Contractors](Contractors)

-As the [FITTEST global picture](https://sourceforge.net/p/fittest/wiki/Home/attachment/FITTEST%20GlobalPic%20v3.7.png) shows, the FITTEST ITE integrates testing tools developed and/or improved as result of the tasks performed through the work packages 3 to 9 of the FITTEST EU project, including but not limited to:
+As the [FITTEST global picture](https://sourceforge.net/p/fittest/wiki/Home/attachment/FITTEST%20GlobalPic%20v3.7.png) shows, the FITTEST ITE for Continuous Testing integrates testing tools developed and/or improved as result of the tasks performed through the work packages 3 to 9 of the FITTEST EU project, including but not limited to:

 * UCL WATT for Coverage testing
 * IBM ConTest for Concurrency testing

Home modified by urueda

urueda — Wed, 17 Apr 2013 18:07:12 -0000

--- v5
+++ v6
@@ -1,6 +1,6 @@
-[Objectives]
+[FITTEST Objectives](Objectives)

-[Contractors]
+[FITTEST Contractors](Contractors)

 As the [FITTEST global picture](https://sourceforge.net/p/fittest/wiki/Home/attachment/FITTEST%20GlobalPic%20v3.7.png) shows, the FITTEST ITE integrates testing tools developed and/or improved as result of the tasks performed through the work packages 3 to 9 of the FITTEST EU project, including but not limited to:

Home modified by urueda

urueda — Wed, 17 Apr 2013 18:06:24 -0000

--- v4
+++ v5
@@ -2,7 +2,7 @@

 [Contractors]

-As the [FITTEST global picture](https://sourceforge.net/p/fittest/wiki/Home/attachment/FITTEST%20GlobalPic%20v3.7.png) shows, the FITTEST ITE integrated testing tools developed and/or improved as result of the tasks performed through the work packages 3 to 9 of the FITTEST EU project, including but not limited to:
+As the [FITTEST global picture](https://sourceforge.net/p/fittest/wiki/Home/attachment/FITTEST%20GlobalPic%20v3.7.png) shows, the FITTEST ITE integrates testing tools developed and/or improved as result of the tasks performed through the work packages 3 to 9 of the FITTEST EU project, including but not limited to:

 * UCL WATT for Coverage testing
 * IBM ConTest for Concurrency testing

Home modified by urueda

urueda — Wed, 17 Apr 2013 18:04:09 -0000

--- v3
+++ v4
@@ -1,3 +1,27 @@
 [Objectives]

 [Contractors]
+
+As the [FITTEST global picture](https://sourceforge.net/p/fittest/wiki/Home/attachment/FITTEST%20GlobalPic%20v3.7.png) shows, the FITTEST ITE integrated testing tools developed and/or improved as result of the tasks performed through the work packages 3 to 9 of the FITTEST EU project, including but not limited to:
+
+* UCL WATT for Coverage testing
+* IBM ConTest for Concurrency testing
+* IBM Focus for Testware generation and Coverage testing
+* B&M CTE for Combinatorial testing
+* FBK TSS for Regression testing
+* FITTEST Continuous Testing Tool
+* GUITEST tool for GUI crash testing
+
+In the global picture, the FITTEST Continuous Testing approach is outlined in more details. It roughly consists of four main stages in a loop (or cycle) as depicted in the picture above. Though the starting point in the cycle depends on the concrete testing scenario and the concrete quality criteria pursued, the typical full-cycle starts instrumenting the System Under Test (SUT). The instrumentation is usually needed for monitoring SUT execution and guiding the testing tasks.
+
+The yellow boxes in the figure represent the evolutionary approach of FITTEST. That is, the FITTEST techniques are optimized when possible to deal with the nature of FI applications, using evolutionary search based software engineering techniques.
+
+The application or System Under Test (SUT) is encapsulated into a Test Case Execution (TCE) environment that enables features of tracing and controlled-execution of the application. The environment consists of instrumentation facilities for the underlying technology and capture-replay utilities that help monitor the test cases generated and executed over the FITTEST cycle.
+
+Three main modules are identified for the TCE environment. The logger feature keeps track of the events (system events, user events, exceptions risen, etc.) during executions of the SUT. The coverage module collects information necessary to measure the degree of testing achieved. The last module runs concurrency tests while the SUT is executed. Three main sources of information come from the TCE environment: logs, coverage and failures/bugs.
+
+The information gathered from the SUT executions is analysed by low-level techniques. For example, from the logged information, FITTEST will do: log diagnosis, model inference and oracle learning. The last one may provide the facility of inferring oracles that predict which SUT executions may be reasonable and may be prone to errors detection. The other two (log diagnosis and model inference) produce artifacts for the next stage in the cycle: testware generation.
+
+The high-level testing techniques (i.e. model-based testing and combinatorial testing) use the artifacts produced to automatically generate abstract test cases. For the combinatorial part, the end-user may interact to adapt the selection of test cases to specific criteria. Mutation testing is another high-level technique that can be used to generate test data using evolutionary test case generation techniques.
+
+The last stage is responsible for compilation of the generated abstract test cases into concrete test cases that the SUT can execute in the context of the TCE. The compilation of the test cases can use oracles learned or other test data generated from evolutionary computations based on the logs, coverage and/or failure information.

Home modified by urueda

urueda — Wed, 17 Apr 2013 17:45:15 -0000

--- v2
+++ v3
@@ -1,16 +1,3 @@
-FITTEST Project objectives
---------------------------
+[Objectives]

-The Future Internet will be a complex interconnection of services, applications, contents and media, on which our society will become increasingly dependent for critical activities such as public utilities, social services, government, learning, finance, business, and entertainment. Consequently, Future Internet applications have to satisfy high quality demands.
-
-Testing is the mostly used quality assurance technique applied in industry. However, the complexity of the technologies involved in the Future Internet makes testing extremely challenging and demands for novel approaches and major advancement in the field.
-
-The overall objective of the FITTEST project is to address these testing challenges, by developing an integrated environment for automated testing, which can monitor the Future Internet application under test and adapt to the dynamic changes observed.
-
-The environment will implement continuous post-release testing since a Future Internet application does not remain fixed after its release. Services and components could be dynamically added by customers and the intended use could change significantly.
-
-The environment will integrate, adapt and automate various techniques for continuous Future Internet testing (e.g. dynamic model inference, model-based testing, log-based diagnosis, oracle learning, combinatorial testing, concurrent testing, regression testing, etc.).
-
-The environment will make use of search based techniques, to make it possible for the abovementioned techniques to automate undecidable problems in order to cope with the Future Internet testing challenges. In this way, we can address unexpected behaviour that may originate from the dynamism, autonomy and self-adaptation involved.
-
-FITTEST results will be evaluated using case studies with real Internet systems like virtual worlds, social networking, highly scalable service providers and a SaaS enabled CASE tool that are highly relevant to the Future Internet vision.
+[Contractors]