The question i am stuck on is on this exercise sheet

http://www.maths.qmul.ac.uk/~ig/MAS338/ex2-07.pdf

Its question 1.

Basically i have done the transition graph, but i dont know how to calculate the probabilities.

I dont just want the answer, i wanna know the method of how to calculate them

Thankyou