Help me to solve this problem (Markov chain)

Printable View