Concept of Semi -Markov Process
Franciszek Grabski
Abstract
Franciszek Grabski
Abstract
Abstract This paper provides the definitions and basic properties related to a discrete state space semi-Markov process. The semi-Markov process is constructed by the so called Markov renewal process that is a special case the two-dimensional Markov sequence. The Markov renewal process is defined by the transition probabilities matrix, called the renewal kernel and an initial distribution or by another characteristics which are equivalent to the renewal kernel. The counting process corresponding to the semi-Markov process allows to determine concept of the process regularity. In the paper are also shown the other methods of determining the semi-Markov process. The presented concepts are illustrated a simple example.
OpenAlex reports 6 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
Abstract This paper provides the definitions and basic properties related to a discrete state space semi-Markov process. The semi-Markov process is constructed by the so called Markov renewal process that is a special case the two-dimensional Markov sequence. The Markov renewal process is defined by the transition probabilities matrix, called the renewal kernel and an initial distribution or by another characteristics which are equivalent to the renewal kernel. The counting process corresponding to the semi-Markov process allows to determine concept of the process regularity. In the paper are also shown the other methods of determining the semi-Markov process. The presented concepts are illustrated a simple example.
Key concepts: Markov renewal process, Markov chain, Markov kernel, Markov process, Markov property, Markov model, Kernel (algebra), Renewal theory