An extensible benchmark and tooling for comparing reverse engineering approaches

    Research output: Contribution to journalArticle


    View graph of relations

    Various tools exist to reverse engineer software source code and generate design information, such as UML projections. Each has specific strengths and weaknesses, however no standardised benchmark exists that can be used to evaluate and compare their performance and effectiveness in a systematic manner. To facilitate such comparison in this paper we introduce the Reverse Engineering to Design Benchmark (RED-BM), which consists of a comprehensive set of Java-based targets for reverse engineering and a formal set of performance measures with which tools and approaches can be analysed and ranked. When used to evaluate 12 industry standard tools performance figures range from 8.82\% to 100\% demonstrating the ability of the benchmark to differentiate between tools. To aid the comparison, analysis and further use of reverse engineering XMI output we have developed a parser which can interpret the XMI output format of the most commonly used reverse engineering applications, and is used in a number of tools.


    • An extensible benchmark and tooling for comparing reverse engineering approaches

      Rights statement: © Copyright by authors 2015. This is an open access article published under a Creative Commons Attribution-NonCommercial-ShareAlike License (, which permits use, distribution and reproduction for non-commercial purposes, provided the author and source are cited and new creations are licensed under the identical terms.

      Final published version, 1 MB, PDF-document


    Original languageEnglish
    Number of pages10
    Pages (from-to)115-124
    JournalInternational Journal on Advances in Software
    Journal publication date30 Jun 2015
    Issue number1&2
    Publication statusPublished - 30 Jun 2015

      Research areas

    • Reverse Engineering, Benchmarking, Tool Comparison, Tool Support, Extensible Methods, XMI, Software Comprehension, UML, UML Reconstruction

    ID: 131816278