Hi everyone, I've got stuck in the following question, can anyone please give me some help?



Basically, I don't know how I can start and that's quite common for me when it comes to Markov Chains.

Thanks very much