# Thread: Markov jump Processes: finding the generator matrix

1. ## Markov jump Processes: finding the generator matrix

Vehicles in a certain country are required to be assessed every year for road-worthiness. At one vehicle assessment center, drivers wait for an average of 15 minutes before the road-worthiness assessment of their vehicle commences. The assessment takes on average 20 minutes to complete. Following the assessment, 80% of vehicles are passed as road-worthy allowing the driver to drive home. A further 15% of vehicles are categorized as a “minor fail”; these vehicles require on average 30 minutes of repair work before the driver is allowed to drive home. The remaining 5% of vehicles are categorized as a “significant fail”; these vehicles require on average three hours of repair work before the driver can go home.

A continuous-time Markov model is to be used to model the operation of the vehicle assessment centre, with states W (waiting for assessment), A (assessment taking place), M (minor repair taking place), S (significant repair taking place) and H (travelling home).

generator matrix i got:

$\displaystyle \dots\dots$$\displaystyle \begin{matrix} W & A & M & S & H \end{matrix}$
$\displaystyle \begin{matrix} W \\ A \\ M \\ S \\ H \end{matrix}\left[ \begin{matrix} \frac{-1}{15} & \frac{1}{15} & 0 & 0 & 0 \\ 0 & \frac{-1}{20} & & & \frac{1}{25} \\ 0& 0 & \frac{-1}{30} & 0 & \frac{1}{30} \\ 0 & 0 & 0 & \frac{-1}{180} & \frac{1}{180} \\ 0 & 0 & 0 & 0 & 0 \end{matrix} \right]$

but i dint know how to find the 2 empty spaces in second row. Any help would be appreciated.

2. ## Re: Markov jump Processes: finding the generator matrix

how did you get to $\displaystyle p_{AH}=\frac{1}{25}$?

3. ## Re: Markov jump Processes: finding the generator matrix

As 80% of them drive home directly their only waiting time will be 1/20. So, I calculated (80%)/20 = 1/25

4. ## Re: Markov jump Processes: finding the generator matrix

likewise.. $\displaystyle 0.05 \times \frac{1}{20}=p_{AS}$

$\displaystyle 0.15 \times \frac{1}{20}=p_{AM}$

5. ## Re: Markov jump Processes: finding the generator matrix

I was calculating taking into account the waiting time in H also. As you take waiting time in H when you enter that state. But actually it has reached state H from A, so the waiting time will be only 1/20. This will agree with your post, right.

6. ## Re: Markov jump Processes: finding the generator matrix

Yes. After assessment, it can go to any of the other progressive states. and your average time for the assessment state is 20 minutes and the calculation follows.

7. ## Re: Markov jump Processes: finding the generator matrix

I find a 2d matrix barcode generator in java for you.
I try it and it can work correctly.