My mid-term is in two days and I really need to understand how to calculate this sort of question.
The equation becomes
I really dont know how to get the solutions from here.
Consider the one-step transition matrix
where and .
Find all stationary distributions of a chain with state space and one-step transition matrix P.
Are any stationary distributions also limiting distributions?