1977•The Annals of ProbabilityOpen access

Birth, Death and Conditioning of Markov Chains

Martin Jacobsen, Jim Pitman

Open full text 15 citations

Abstract

Given a Markov chain with stationary transition probabilities, we study random times $\tau$ determined by the evolution of the Markov chain for which either the pre-$\tau$ or post-$\tau$ process is Markovian with stationary transition probabilities. A complete description is given of all such random times which admit a conditional independence property analogous to the strong Markov property at a stopping time.

Open-access reader

About this research paper

What this paper is about

Given a Markov chain with stationary transition probabilities, we study random times $\tau$ determined by the evolution of the Markov chain for which either the pre-$\tau$ or post-$\tau$ process is Markovian with stationary transition probabilities. A complete description is given of all such random times which admit a conditional independence property analogous to the strong Markov property at a stopping time.

Why it matters

OpenAlex reports 15 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Given a Markov chain with stationary transition probabilities, we study random times $\tau$ determined by the evolution of the Markov chain for which either the pre-$\tau$ or post-$\tau$ process is Markovian with stationary transition probabilities. A complete description is given of all such random times which admit a conditional independence property analogous to the strong Markov property at a stopping time.

Key concepts: Markov chain, Markov property, Mathematics, Markov renewal process, Additive Markov chain, Variable-order Markov model, Markov chain mixing time, Markov process

Related papers

Back to paper searchBrowse research topicsOriginal source
Birth, Death and Conditioning of Markov Chains — Research Paper | ScholarLens