Thread: Markov chain

Each year at River High School, the parents sit on a committee.

Curently:
30% are in the Sports committee
20% are on the arts committee
50% are on the Graduation committee

At the end of the school year, the parents can change committees
Here are the changes that took place last June

10% of the parents from each committee stayed on their committee
15% of the members on the Sports committee joined the Graduation committee
5% of the members on the Arts committee joined the sports committee
30% of the members of the Graduation committee joined the Arts committee

a) create a transition matrix to show the changes

Answer:

0.10 0.75 0.15
0.05 0.10 0.85
0.60 0.30 0.10


b) If the trend continues, determine the percentage of parents on each committee once it stabilizes. Povide proof of stabilization

No idea. Please help

1st 10% stay in their respected committees.



2nd 15% of S joined G; Therefore, 85% went to A from S.



3rd 5% of A joined S which means 85% from A went to G.



Last 30% of G go to A. Hence, 60% go to S from G. Now we have our Stochastic Matrix.



Initial Vector:


Now, you need to diagonalize the stochastic matrix.



Solve this to obtain your long-run steady state vector.

Let be the limiting probability of a parent being on committe .










Solve the system. It's not as bad as it looks.

EDIT: The initial state shouldn't matter.

Originally Posted by terminator

Each year at River High School, the parents sit on a committee.

Curently:
30% are in the Sports committee
20% are on the arts committee
50% are on the Graduation committee

At the end of the school year, the parents can change committees
Here are the changes that took place last June

10% of the parents from each committee stayed on their committee
15% of the members on the Sports committee joined the Graduation committee
5% of the members on the Arts committee joined the sports committee
30% of the members of the Graduation committee joined the Arts committee

a) create a transition matrix to show the changes

Answer:

0.10 0.75 0.15
0.05 0.10 0.85
0.60 0.30 0.10


b) If the trend continues, determine the percentage of parents on each committee once it stabilizes. Povide proof of stabilization

No idea. Please help

As dwsmith points out, you have found the transpose of the correct answer to part (a). [In a transition matrix, the elements in each column should have sum 1. But in your matrix, the rows add up to 1.]

But you don't need to diagonalise the matrix. In fact, if the matrix is , and the steady state vector is , then . (That's more or less the definition of the steady state: it doesn't change when you multiply it by the matrix.) In other words, is the eigenvector of corresponding to the eigenvalue 1.

So you just have to solve the equations , normalising the result so that the coordinates of have sum 1.

Edit. ... and that is exactly what Random Variable has just suggested.

What if there were a state that was not directly or indirectly accessible from another state? How would you deal with that?

Originally Posted by Random Variable

What if there were a state that was not directly or indirectly accessible from another state? How would you deal with that?

The method only applies to a regular stochastic process. If the process is not regular then you would somehow need to restrict attention to the invariant subspace of the state space containing the given initial state.

the interesting thing about a regular stochastic process is that the steady state is independent of the initial state.