I'm a little unsure if my approach here is correct, which is making it difficult to find the limit. Any and all help will be appreciated!
Letbe a primitive finite state Markov chain with transition matrix
and stationary distribution
. Define the process
by:
![]()
Show thatis a Markov chain, and compute:
What I've done:
So I need to show thatis only determined by
, ie:
So, supposea & b are just some numbers. Then:
Plugging in the definition of:
=
Becauseare primitive Markov-Chains, can I say that
=
becausedoesn't depend on
? This is basically where I'm stuck
![]()


LinkBack URL
About LinkBacks