Concept of Semi -Markov Process

In: Scientific Journal of Polish Naval Academy, Band 206, Heft 3, S. 25-36

Abstract

Abstract
This paper provides the definitions and basic properties related to a discrete state space semi-Markov process. The semi-Markov process is constructed by the so called Markov renewal process that is a special case the two-dimensional Markov sequence. The Markov renewal process is defined by the transition probabilities matrix, called the renewal kernel and an initial distribution or by another characteristics which are equivalent to the renewal kernel. The counting process corresponding to the semi-Markov process allows to determine concept of the process regularity. In the paper are also shown the other methods of determining the semi-Markov process. The presented concepts are illustrated a simple example.