The Strong Law of Large Numbers for Markov Chains in Markovian Environments
Guo Mingle
Abstract
Guo Mingle
Abstract
In this paper,a strong law of large numbers for funct io n of countable Markov chains in Markovian environments are investigated.Moreover ,some sufficient conditions on the jointly Markov chains and sample function of the jointly Markov chains are given.At last,R θchains are systematically studied,some sufficient conditions for the strong law of large numbers to hold for function of Markov chains in Markovian environments are obtained.
A significance statement is not available in the OpenAlex record.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
In this paper,a strong law of large numbers for funct io n of countable Markov chains in Markovian environments are investigated.Moreover ,some sufficient conditions on the jointly Markov chains and sample function of the jointly Markov chains are given.At last,R θchains are systematically studied,some sufficient conditions for the strong law of large numbers to hold for function of Markov chains in Markovian environments are obtained.
Key concepts: Markov chain, Markov process, Examples of Markov chains, Markov chain mixing time, Markov property, Balance equation, Countable set, Markov renewal process