Model-based testing in practice: An experience report from the web applications domain

Vahid Garousi*, Alper Buğra Keleş, Yunus Balaman, Zeynep Özdemir Güler, Andrea Arcuri

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

In the context of a software testing company, we have deployed the model-based testing (MBT) approach to take the company's test automation practices to higher levels of maturity and capability. We have chosen, from a set of open-source/commercial MBT tools, an open-source tool named GraphWalker, and have pragmatically used MBT for end-to-end test automation of several large web and mobile applications under test. The MBT approach has provided, so far in our project, various tangible and intangible benefits in terms of improved test coverage (number of paths tested), improved test-design practices, and also improved real-fault detection effectiveness. The goal of this experience report (applied research report), done based on “action research”, is to share our experience of applying and evaluating MBT as a software technology (technique and tool) in a real industrial setting. We aim at contributing to the body of empirical evidence in industrial application of MBT by sharing our industry-academia project on applying MBT in practice, the insights that we have gained, and the challenges and questions that we have faced and tackled so far. We discuss an overview of the industrial setting, provide motivation, explain the events leading to the outcomes, discuss the challenges faced, summarize the outcomes, and conclude with lessons learned, take-away messages, and practical advices based on the described experience. By learning from the best practices in this paper, other test engineers could conduct more mature MBT in their test projects.

Original languageEnglish
Article number111032
JournalJournal of Systems and Software
Volume180
Early online date30 Jun 2021
DOIs
Publication statusPublished - Oct 2021

Bibliographical note

Funding Information:
This work was supported by the European ITEA3 program via the ?TESTOMAT (The Next Level of Test Automation)? project with grant number 16032, by the Scientific and Technological Research Council of Turkey (T?B?TAK) with grant number 9180076, and also by the Research Council of Norway with grant number 274385.

Funding Information:
This work was supported by the European ITEA3 program via the “TESTOMAT (The Next Level of Test Automation)” project with grant number 16032, by the Scientific and Technological Research Council of Turkey (TÜBİTAK) with grant number 9180076 , and also by the Research Council of Norway with grant number 274385 .

Publisher Copyright:
© 2021 Elsevier Inc.

Keywords

  • Applied research report
  • Experience report
  • Model-based testing
  • Software testing
  • Test automation
  • Web applications

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Model-based testing in practice: An experience report from the web applications domain'. Together they form a unique fingerprint.

Cite this