2020•arXiv (Cornell University)Open access

Perturbation theory and uniform ergodicity for discrete-time Markov chains

Yong-Hua Mao, Yan-Hong Song

Open full text 1 citations

Abstract

We study perturbation theory and uniform ergodicity for discrete-time Markov chains on general state spaces in terms of the uniform moments of the first hitting times on some set. The methods we adopt are different from previous ones. For reversible and non-negative definite Markov chains, we first investigate the geometrically ergodic convergence rates. Based on the estimates, together with a first passage formula, we then get the convergence rates in uniform ergodicity. If the transition kernel $P$ is only reversible, we transfer to study the two-skeleton chain with the transition kernel $P^2$. At a technical level, the crucial point is to connect the geometric moments of the first return times between $P$ and $P^2$.

Open-access reader

About this research paper

What this paper is about

We study perturbation theory and uniform ergodicity for discrete-time Markov chains on general state spaces in terms of the uniform moments of the first hitting times on some set. The methods we adopt are different from previous ones. For reversible and non-negative definite Markov chains, we first investigate the geometrically ergodic convergence rates. Based on the estimates, together with a first passage formula, we then get the convergence rates in uniform ergodicity. If the transition kernel $P$ is only reversible, we transfer to study the two-skeleton chain with the transition kernel $P^2$. At a technical level, the crucial point is to connect the geometric moments of the first return times between $P$ and $P^2$.

Why it matters

OpenAlex reports 1 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

We study perturbation theory and uniform ergodicity for discrete-time Markov chains on general state spaces in terms of the uniform moments of the first hitting times on some set. The methods we adopt are different from previous ones. For reversible and non-negative definite Markov chains, we first investigate the geometrically ergodic convergence rates. Based on the estimates, together with a first passage formula, we then get the convergence rates in uniform ergodicity. If the transition kernel $P$ is only reversible, we transfer to study the two-skeleton chain with the transition kernel $P^2$. At a technical level, the crucial point is to connect the geometric moments of the first return times between $P$ and $P^2$.

Key concepts: Ergodicity, Markov chain, Statistical physics, Discrete time and continuous time, Examples of Markov chains, Balance equation, Mathematics, Perturbation (astronomy)

Related papers

Back to paper searchBrowse research topicsOriginal source
Perturbation theory and uniform ergodicity for discrete-time Markov chains — Research Paper | ScholarLens