How do i find a limiting distribution of a markov chain if the transition matrix is not regular? Will a limiting distribution even exist?
Also, what does it mean if the initial distribution of a Markov chain is equal to its limiting distribution? What does this imply about the distribution of the Markov chain?
Thanks!