Let be a discrete-time Markov chain on state space S.
Draw the transition graph of a discrete-time Markov chain on 4 states with 2
equivalence classes of intercommunicating states.
I can't get the rows of my matrix add upto 1. Can please help.
Thanks