A Comparison of Time- and Reward-Bounded Probabilistic Model Checking Techniques

Ernst Moritz Hahn, Arnd Hartmanns

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)


In the design of probabilistic timed systems, requirements concerning behaviour that occurs within a given time or energy budget are of central importance. We observe that model-checking such requirements for probabilistic timed automata can be reduced to checking reward-bounded properties on Markov decision processes. This is traditionally implemented by unfolding the model according to the bound, or by solving a sequence of linear programs. Neither scales well to large models. Using value iteration in place of linear programming achieves scalability but accumulates approximation error. In this paper, we correct the value iteration-based scheme, present two new approaches based on scheduler enumeration and state elimination, and compare the practical performance and scalability of all techniques on a number of case studies from the literature. We show that state elimination can significantly reduce runtime for large models or high bounds.
Original languageEnglish
Title of host publicationDependable Software Engineering: Theories, Tools, and Applications - Second International Symposium, SETTA 2016, Beijing, China, November 9-11, 2016, Proceedings
Number of pages16
Publication statusPublished - 06 Oct 2016
Externally publishedYes


Dive into the research topics of 'A Comparison of Time- and Reward-Bounded Probabilistic Model Checking Techniques'. Together they form a unique fingerprint.

Cite this