Conditional Markov Renewal Theory I. Finite and Denumerable State Space
Steven P. Lalley
Abstract
Open-access reader
Steven P. Lalley
Abstract
Open-access reader
A renewal theory is developed for sums of independent random variables whose distributions are determined by the current state of a Markov chain (also known as "Markov additive" processes, or "semi-Markov" processes). This theory departs from existing theories in that its conclusions are required to be valid conditionally for a given realization of the Markov Chain. It rests on a peculiar coupling construction which differs markedly from existing coupling arguments.
OpenAlex reports 19 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
A renewal theory is developed for sums of independent random variables whose distributions are determined by the current state of a Markov chain (also known as "Markov additive" processes, or "semi-Markov" processes). This theory departs from existing theories in that its conclusions are required to be valid conditionally for a given realization of the Markov Chain. It rests on a peculiar coupling construction which differs markedly from existing coupling arguments.
Key concepts: Markov chain, Mathematics, Markov renewal process, Markov kernel, Markov property, Variable-order Markov model, Additive Markov chain, Markov chain mixing time