Results 1 to 3 of 3

Thread: Expected value of markov chain URGENT!

  1. #1
    Newbie
    Joined
    Sep 2009
    Posts
    23

    Expected value of markov chain URGENT!

    i have a 3 state (0,1,2) markov chain with transition matrix p=
    1/2, 1/3, 1/6
    0, 1/3, 2/3
    1/2, 0, 1/2
    and that p(x0= 0) = p(x0= 1)= 1/2

    and i need to fond E[X3]

    so i find p^3 by matrix multiplication to be:
    13/36, 11/54,47/108
    4/9, 4/27, 11/27
    5/12, 2/9, 13/36

    now the solution says the answer is 1/2(47/108)+1/2(11/54)+1/4(13/36)

    but i have no idea how this is obtained! please help!
    Follow Math Help Forum on Facebook and Google+

  2. #2
    Grand Panjandrum
    Joined
    Nov 2005
    From
    someplace
    Posts
    14,972
    Thanks
    5
    Quote Originally Posted by mtlchris View Post
    i have a 3 state (0,1,2) markov chain with transition matrix p=
    1/2, 1/3, 1/6
    0, 1/3, 2/3
    1/2, 0, 1/2
    and that p(x0= 0) = p(x0= 1)= 1/2

    and i need to fond E[X3]

    so i find p^3 by matrix multiplication to be:
    13/36, 11/54,47/108
    4/9, 4/27, 11/27
    5/12, 2/9, 13/36

    now the solution says the answer is 1/2(47/108)+1/2(11/54)+1/4(13/36)

    but i have no idea how this is obtained! please help!
    The distribution over states after three steps where $\displaystyle A$ is the single step transition matrix and $\displaystyle x_0$ the initial distribution over states is:

    $\displaystyle x_3=x_0A^3=[1/2, 1/2, 0]A^3$

    From this distribution you calculate the expectation for the state.

    CB
    Follow Math Help Forum on Facebook and Google+

  3. #3
    Newbie
    Joined
    Oct 2017
    From
    Canada
    Posts
    1

    Re: Expected value of markov chain URGENT!

    This might be a long-shot but... does anyone know how to do this question still?
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Markov Chain of random variables from a primitive markov chain
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: Oct 19th 2011, 08:12 AM
  2. [SOLVED] Expected Value Markov Chain
    Posted in the Advanced Statistics Forum
    Replies: 3
    Last Post: Feb 14th 2011, 10:07 AM
  3. Markov chain or not
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: Mar 26th 2010, 10:35 AM
  4. Expected Value and markov conditional distribution
    Posted in the Advanced Statistics Forum
    Replies: 4
    Last Post: Apr 29th 2009, 05:50 PM
  5. Replies: 2
    Last Post: Oct 28th 2008, 06:32 PM

Search Tags


/mathhelpforum @mathhelpforum