I have the following transition matrix for a Markov chain.
This represents the problem:
A child is standing in a square on the grid (namely x).
Once time per second, he jumps to another square that is adjacent to x.
The grid looks like this:[/size][size=14]Code:* - * - * - * | 1 | 2 | 3 | * - * - * - * | 4 | 5 | 6 | * - * - * - * | 7 | 8 | 9 | * - * - * - *
My question is, how do I find the steady state vector for the Markov chain?