Birth, Death and Conditioning of Markov Chains
Martin Jacobsen, Jim Pitman
Abstract
Open-access reader
Martin Jacobsen, Jim Pitman
Abstract
Open-access reader
Given a Markov chain with stationary transition probabilities, we study random times $\tau$ determined by the evolution of the Markov chain for which either the pre-$\tau$ or post-$\tau$ process is Markovian with stationary transition probabilities. A complete description is given of all such random times which admit a conditional independence property analogous to the strong Markov property at a stopping time.
OpenAlex reports 15 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
Given a Markov chain with stationary transition probabilities, we study random times $\tau$ determined by the evolution of the Markov chain for which either the pre-$\tau$ or post-$\tau$ process is Markovian with stationary transition probabilities. A complete description is given of all such random times which admit a conditional independence property analogous to the strong Markov property at a stopping time.
Key concepts: Markov chain, Markov property, Mathematics, Markov renewal process, Additive Markov chain, Variable-order Markov model, Markov chain mixing time, Markov process