http://img213.imageshack.us/img213/6344/nasp.jpg
I've got the transient states as 1,2,3. And the recurrent states as 4,5, and the communication classes I think are {1,2,3} and {4,5}.
1.To calculate P(X2 = 5 | X0 = 1), is it just finding P^2_(1,5)? Which equals 1/8?
2. For P(X3 = 1 | X0=1), I tried finding P^3_(1,1) which I got 1/24. Is that correct?
3. For finding P(X2=4), do I just take π*(P^2)?