An open-source tool for automated generation of black-box xUnit test code and its industrial evaluation

Christian Wiederseiner*, Shahnewaz A. Jolly, Vahid Garousi, Matt M. Eskandar

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

The body of knowledge in the area of black-box unit testing is quite well established, e.g., the concepts of category partitioning, boundary value analysis, and pair-wise testing. However, tool support to apply the existing techniques in large-scale industrial software projects is fairly limited. Although tools such as HexaWise enable testers in automatic generation of all-combination pair-wise test input data, nevertheless converting them to actual test case source code (e.g., in NUnit) is both very tedious and also error prone. To address the above challenge, we have developed an open-source tool, referred to as AutoBBUT, for automated generation of black-box NUnit test cases for the C# .Net platform. Evaluation of the tool in an industrial setting by using it to automatically generate more than 1,962 NUnit test cases (having 15,906 test line of code) in NUnit shows the effectiveness of the tool in saving testers a lot of time and also preventing unwanted defects and/or test smells in test code, which can occur due to manual test code development.

Original languageEnglish
Title of host publicationTesting - Practice and Research Techniques - 5th International Academic and Industrial Conference, TAIC PART 2010, Proceedings
Pages118-128
Number of pages11
DOIs
Publication statusPublished - 12 Nov 2010
Externally publishedYes
EventTesting: Academic and Industrial Conference - Practice and Research Techniques, TAIC PART 2010 - Windsor, United Kingdom
Duration: 03 Sep 201005 Sep 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume6303 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceTesting: Academic and Industrial Conference - Practice and Research Techniques, TAIC PART 2010
CountryUnited Kingdom
CityWindsor
Period03/09/201005/09/2010

Keywords

  • automated test code generation
  • black-box unit testing
  • industrial evaluation
  • Microsoft Visual Studio team test
  • Open-source tool
  • SCADA

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'An open-source tool for automated generation of black-box xUnit test code and its industrial evaluation'. Together they form a unique fingerprint.

  • Cite this

    Wiederseiner, C., Jolly, S. A., Garousi, V., & Eskandar, M. M. (2010). An open-source tool for automated generation of black-box xUnit test code and its industrial evaluation. In Testing - Practice and Research Techniques - 5th International Academic and Industrial Conference, TAIC PART 2010, Proceedings (pp. 118-128). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6303 LNCS). https://doi.org/10.1007/978-3-642-15585-7_11