Thread: Markov Chain & Transition Probability Matrix

Hi there, I have a question here which I still couldn't figure it out. Can anyone here help me with it? Thanks.


Five balls are distributed between 2 urns A and B. Each period, an urn is selected at random, and if it is not empty, a ball from that urn is removed and placed into the other urn.

Let Xn denote the number of balls in the urn A.
a) Write down the transition matrix of this chain.

Assuming if there are 0 balls in one urn, and that urn is chosen, you pick a ball from the other urn and put into the empty urn.

Thanks.. hehhee..