On the total variation distance of semi-markov chains

Bacci, Giorgio and Bacci, Giovanni and Larsen, Kim Guldstrand and Mardare, Radu; Pitts, Andrew, ed. (2015) On the total variation distance of semi-markov chains. In: Foundations of Software Science and Computation Structures. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9034 . Springer-Verlag, GBR, pp. 185-199. ISBN 9783662466773 (https://doi.org/10.1007/978-3-662-46678-0_12)

[thumbnail of Bacci-etal-FOSSACS2015-On-total-variation-distance-semi-markov-chains]
Preview
Text. Filename: Bacci_etal_FOSSACS2015_On_total_variation_distance_semi_markov_chains.pdf
Accepted Author Manuscript

Download (333kB)| Preview

Abstract

Semi-Markov chains (SMCs) are continuous-time probabilistic transition systems where the residence time on states is governed by generic distributions on the positive real line. This paper shows the tight relation between the total variation distance on SMCs and their model checking problem over linear real-time specifications. Specifically, we prove that the total variation between two SMCs coincides with the maximal difference w.r.t. the likelihood of satisfying arbitrary MTL formulas or ω-languages recognized by timed automata. Computing this distance (i.e., solving its threshold problem) is NPhard and its decidability is an open problem. Nevertheless, we propose an algorithm for approximating it with arbitrary precision.