# Thread: Markov Model

1. ## Markov Model

I was given a scenario and have to represent the facts using the Markov model of X(underscore n)=A^n x(underscore 0)

The facts are: there are 3 modes of transportation- train, bus or car. If a train is taken, there is a 0.2 probability that there will be a signal failure. If this happens the following day, a person will take the bus, otherwise he will take a train again. If a bus is taken, there is a 0.3 probability that it is late. If this happens, the person will take the car, otherwise he will take the bus again. If a car is taken, there is a 0.4 probability the roads will be congested. If this happens the following day, the person will take the train, otherwise he will take the car again.
The first day of travelling, the person goes by train.

How would I represent this situation? Would I use a Stochastic matrix somehow?
Also, how would I go about finding the outcome of the 5th day, and the long state vector?

Thank you

2. This should probably be in the linear and abstract algebra forum.

I am not 100% on my transition matrix but here is what I obtained.

$\begin{bmatrix}
& train & bus & car\\
train & .8 & 0 & .4\\
bus & .2 & .7 & 0\\
car & 0 & .3 & .6
\end{bmatrix}$
and $\mathbf{x}_0=\begin{bmatrix}
1\\
0\\
0
\end{bmatrix}$

X is your eigenvector matrix and D is your diagonal matrix
$A^5=XD^5X^{-1}\mathbf{x}_0$