INTUITESTBEDS 2020

Context: 2 nd generation (Layout-based) and 3 rd generation (Visual) GUI testing are two approaches for testing mobile GUIs, both with individual benefits and drawbacks. Previous research has presented approaches to translate 2 nd generation scripts to 3 rd generation scripts but not the vice versa. Goal: The objective of this work is to provide Proof of Concept of the effectiveness of automatic translation between existing 3 rd generation test scripts to 2 nd generation test scripts. Method: A tool architecture is presented and implemented in a tool capable of translating most 3 rd generation interactions with the GUI of an Android app into 2 nd generation instructions and oracles for the Espresso testing tool.Results: We validate our approach on two test suites of our own creation, consisting of 30 test cases each. The measured success rate of the translation is 96.7% (58 working test cases out of 60 applications of the translator). Conclusion: The study provides support for the feasibility of a translation-based approach from 3 rd to 2 nd generation test cases. However, additional work is needed to make the approach applicable in real-world scenarios or larger open-source test suites.

Link to Publication: https://doi.org/10.1109/ICSTW50294.2020.00027

Riccardo Coppola

Politecnico di Torino

Luca Ardito

Politecnico di Torino

Italy

Marco Torchiano

Politecnico di Torino

Italy

Emil Alégroth

Blekinge Institute of Technology

Sweden

Smart TV application (app) is a new technological software app that can deal with smart TV devices to add more functionality and features. Despite its importance nowadays, far too little attention has been paid to present a systematic approach to test this kind of app so far. In this paper, we present a systematic model-based testing approach for smart TV app. We used our new notion of model separation to use sub-models based on the user preference instead of the exhaustive testing to generate the test cases. Based on the constructed model, we generated a set of test cases to assess the selected paths to the chosen destination in the app. We also defined new mutation operators for smart TV app to assess our testing approach. The evaluation results showed that our approach can generate more comprehensive models of smart TV apps with less time as compared to manual exploratory testing. The results also showed that our approach can generate effective test cases in term of fault detection.

Link to Publication: https://doi.org/10.1109/ICSTW50294.2020.00026

Bestoun S. Ahmed

Karlstad University

Sweden

Angelo Gargantini

University of Bergamo

Italy

Miroslav Bures

Czech Technical University in Prague

Czech Republic

The Agile and DevOps transformation of software development practices enhances the need for increased automation of functional testing, especially for regression testing. This poses challenges both in the effort that needs to be devoted to the creation and maintenance of automated test scripts, and in their relevance (i.e. their alignment with business needs). Test automation is still difficult to implement and maintain and the return on investment comes late while projects tend to be short. In this context, we have experimented a lightweight model-based test automation approach to address both productivity and relevance challenges. It integrates test automation through a simple process and tool-chain experimented on large IT projects.

Link to Publication: https://doi.org/10.1109/ICSTW50294.2020.00028

Elodie Bernard

FEMTO-ST Institute, Univ. Bourgogne Franche-Comté, Sogeti

France

Fabrice Ambert

FEMTO-ST Institute

Bruno Legeard

FEMTO-ST / DISC

France

The testing of applications with a Graphical User Interface (GUI) is a complex activity because of the infinity of possible event sequences. In the field of GUI Testing, model-based approaches based on reverse engineering of GUI application have been proposed to generate test cases. Unfortunately, evidences show that these techniques do not support some of the features of modern GUI applications. These features include dynamic widgets instantiation or advanced interaction techniques (e.g. multi-touch). In this paper, we propose to build models of the applications from requirements, as it is standard practice in Model-Based Testing. To do so, we identified ICO (Interactive Cooperative Object) as one of the modelling techniques allowing the description of complex GUI behavior. We demonstrate that this notation is suitable for generating test cases targeting complex GUI applications in a process derived from the standard Model-Based Testing process.

Link to Publication: https://doi.org/10.1109/ICSTW50294.2020.00029

Alexandre Canny

ICS-IRIT, Université Toulouse III Paul Sabatier

France

Philippe Palanque

ICS-IRIT, Université Toulouse III Paul Sabatier

France

David Navarre

ICS-IRIT, Université Toulouse III Paul Sabatier

France