Hello, liedora!
Did you try anything?
. .
. .
We have: .
Hi Guys, just need a bit of help with this question. Suppose we have P = [0 1/2 1/2; 1 0 0; 1 0 0] and let Q_0=[x y z] where x,y,z >= 0 and x+y+z = 1.
How would I find Q_(2n) and Q_(2n-1), that is the state distribution after an even or odd number of steps? And then how would we use this to explain whether or not the limit distribution exists.
Thanks in advance
Hi Soroban I think that your matrix multiplication is incorrect, for example by hand and in MATLAB I got P^(2n) = P^2 = [1 0 0;0 1/2 1/2;0 1/2 1/2] and P^(2n+1) = P^3 = [0 1/2 1/2 ; 1 0 0 ; 1 0 0]. But I now understand what it means to find the state distribution after an odd or even amount of steps. So thanks for that
Also what does it mean by the limit distribution (using the above results we have established) I can't seem to decrypt the notes but I have a feeling the limit distribution does not exist.. Not sure how to show this however.
Thanks for your fast reply Soroban.
Yes, your calculations are correct.
For the limit distribution, just think of it as a limit in normal times. After a certain index N, you should have something approaching the limiting distribution. But here, it's oscillating, you'll never get a unique limit.
If you want to do it formally, just look for how one defines the limiting distribution of a Markov chain.