Thus we could take state:
Thus our state vector is six dimensional with the probability of the state
Now we need to compile the transition matrix , where is the probability
of ending in state when we start in state .
An absorbing state is one which once you get into it you cannot leave it, so
from what we know about the model we know that state 1:aa,aa and state
6: bb, bb are absorbing, and the associated element of corresponding to
the transitions from 1 to 1 is , and from 6 to 6 is also .