Consider a Markov Chain with state space {1,2,3}, initial distribution and one-step transition matrix P where P is the attached image.

Show

(1)

(2)

(3)

(4)

Printable View

- September 5th 2009, 04:34 PMBrooketheChookMarkov chain
Consider a Markov Chain with state space {1,2,3}, initial distribution and one-step transition matrix P where P is the attached image.

Show

(1)

(2)

(3)

(4) - September 5th 2009, 10:56 PMCaptainBlack