Test automation has been an acknowledged software engineering best practice for years. However, the topic involves more than the repeated execution of test cases that often comes first to mind. Simply running test cases using a unit testing framework is no longer enough for test automation to keep up with the ever-shorter release cycles driven by continuous deployment and technological innovations such as microservices and DevOps pipelines. Now test automation needs to rise to the next level by going beyond mere test execution. The NEXTA workshop will explore how to advance test automation to further contribute to software quality in the context of tomorrow’s rapid release cycles. Take-aways for industry practitioners and academic researchers will encompass test case generation, automated test result analysis, test suite assessment and maintenance, and infrastructure for the future of test automation.
All information about this workshop can be found at the workshop’s official website: https://www.testomatproject.eu/nexta2020.
Sat 24 Oct Times are displayed in time zone: Greenwich Mean Time : Lisbon
09:00 - 10:30: Welcome + Session: Process ImprovementNEXTA 2020 at D. Luis Chair(s): Pasqualina PotenaRISE Research Institutes of Sweden AB | |||
09:00 - 09:15 Day opening | Welcome address and practical arrangements NEXTA 2020 | ||
09:15 - 09:45 Full-paper | Test Automation Process Improvement in a DevOps Team: Experience report NEXTA 2020 Link to publication DOI | ||
09:45 - 10:05 Short-paper | Test Automation Challenges for Application Landscape Frameworks NEXTA 2020 Nils WildResearch Group Software Construction RWTH Aachen University, Horst LichterRWTH Aachen University, Peter KehrenResearch Group Software Construction RWTH Aachen University Link to publication DOI | ||
10:05 - 10:25 Full-paper | Test Automation Improvement Model - TAIM 2.0 NEXTA 2020 Sigrid EldhEricsson Link to publication DOI |
11:00 - 12:30: Session: OptimisationNEXTA 2020 at D. Luis Chair(s): Adnan CausevicMälardalen University | |||
11:00 - 11:30 Full-paper | Optimization of automated executions based on integration test configurations of embedded software NEXTA 2020 Masashi MizoguchiHitachi Ltd., Takahiro IidaHitachi Automotive Systems Ltd., Toru IrieHitachi Automotive Systems Ltd. Link to publication DOI | ||
11:30 - 12:00 Full-paper | Selective Regression Testing based on Big Data: Comparing Feature Extraction Techniques NEXTA 2020 Khaled Al-SabbaghUniversity of Gothenburg, Miroslaw StaronUniversity of Gothenburg, Regina HebigChalmers | Gothenburg University, Miroslaw OchodekPoznan University of Technology, Wilhelm MedingEricsson Link to publication DOI | ||
12:00 - 12:20 Full-paper | Runtime Prioritization with the Classification Tree Method for Test Automation NEXTA 2020 Link to publication DOI |
14:00 - 15:30: Session: Test GenerationNEXTA 2020 at D. Luis Chair(s): Serge DemeyerUniversity of Antwerp, Belgium | |||
14:00 - 14:30 Full-paper | Optimizing the Parameters of an Evolutionary Algorithm for Fuzzing and Test Data Generation NEXTA 2020 Ralf GerlichDr. Rainer Gerlich System and Software Engineering, Christian R. PrauseGerman Aerospace Center - Space Administration Link to publication DOI | ||
14:30 - 15:00 Full-paper | Boundary Value Exploration for Software Analysis NEXTA 2020 Felix DobslawChalmers University of Technology, Francisco GomesChalmers | University of Gothenburg, Robert FeldtChalmers University of Technology Link to publication DOI | ||
15:00 - 15:20 Short-paper | Test Data Generation for MC/DC Criterion using Reinforcement Learning NEXTA 2020 Ján ČegiňFaculty of Informatics and Information Technologies Slovak Technical University, Karol RástočnýFaculty of Informatics and Information Technologies, Slovak University of Technology in Bratislava Link to publication DOI |
16:00 - 17:30: Session: User-Interface Testing + ClosingNEXTA 2020 at D. Luis Chair(s): Kristian WiklundEricsson AB | |||
16:00 - 16:30 Full-paper | On the Industrial Applicability of Augmented Testing: An Empirical Study NEXTA 2020 Michel NassBlekinge Institute of Technology, Emil AlégrothBlekinge Institute of Technology, Robert FeldtChalmers University of Technology Link to publication DOI | ||
16:30 - 16:50 Full-paper | Session-Based Recommender Systems for Action Selection in GUI Test Generation NEXTA 2020 Link to publication DOI | ||
16:50 - 17:30 Awards | Award Ceremony -- Best Question Award; Best Presentation Award; Most influential tweet award NEXTA 2020 |
Call for Submissions
NEXTA solicits contributions targeting all aspects of test automation, from initial test design to automated verdict analysis. Topics of interest include, but are not limited to, the following:
- Test execution automation
- Test case generation
- Automatic test design generation
- Analytics, learning and big data in relation to test automation
- Automatic aspects management in test, progress, reporting, planning etc.
- Visualization of test
- Evolution of test automation
- Test suite architecture and infrastructure
- Test environment, simulation, and other contextual issues for automated testing
- Test tools, frameworks, and general support for test automation
- Testing in an agile and continuous integration context, and testing within DevOps
- Orchestration of test
- Metrics, benchmarks, and estimation on any type of test automation
- Any type of test technologies relying on automation of test
- Process improvements and assessments related to test automation
- Test automation maturity and experience reports on test automation
- Automatic retrieval of test data and test preparation aspect
- Maintainability, monitoring and refactoring of automated test suites
- Training and education on automated testing
- Automated test for product lines and high-variability systems
- Test automation patterns
- Automated test oracles
NEXTA accepts the following types of original papers
- Technical Papers (max. 8 pages in IEEE format) Full papers presenting research results or industrial practices related to the next generation of test automation.
- Tool Papers (max. 4 pages in IEEE format) Tool papers introduce tools that implement an approach to support the transition to the next generation of test automation. A tool paper submission must include either 1) a URL to a screencast of the tool in action, or 2) a runnable version of the tool for evaluation by the program committee.
- Position and Experience Papers (max. 4 pages in IEEE format) Short papers introducing challenges, visions, positions or preliminary results within the scope of the workshop. Experience reports and papers on open challenges in industry are especially welcome.
Authors should submit a PDF version of their paper through the NEXTA 2020 paper submission site: https://easychair.org/conferences/?conf=nexta2020. Note that all accepted papers will be part of the ICST joint workshop proceedings published in the IEEE Digital Library.