I have the following transition matrix for a Markov chain.

[/size]

This represents the problem:

A child is standing in a square on the grid (namely x).

Once time per second, he jumps to another square that is adjacent to x.

The grid looks like this:[/size][size=14]Code:* - * - * - * | 1 | 2 | 3 | * - * - * - * | 4 | 5 | 6 | * - * - * - * | 7 | 8 | 9 | * - * - * - *

My question is, how do I find the steady state vector for the Markov chain?