Let {Xn, n>= 0} be a Markov chain with M states. Suppose that i,j are in the state space E. Prove that d(i) <= M, where d(i) is the period for state i. How do I prove this?
Follow Math Help Forum on Facebook and Google+
View Tag Cloud