Results 1 to 4 of 4
Like Tree1Thanks
  • 1 Post By anonimnystefy

Math Help - Markov Chain Transition Probabilities Help.

  1. #1
    Newbie
    Joined
    Sep 2012
    From
    Sheffield
    Posts
    2

    Markov Chain Transition Probabilities Help.

    Hi. For a project I am using a Markov Chain model with 17 states. I have used data to estimate transition probabilities. From these transition probabilities I can get n-step transition probabilities, i.e. the probability of going from state i to state j in exactly n steps. I would like to calculate the probability of going from state i to state j within n steps. I have searched through my literature but can't find a way to do this. Can anybody offer any help?

    Thanks in advance,
    Chloe.
    Follow Math Help Forum on Facebook and Google+

  2. #2
    Member anonimnystefy's Avatar
    Joined
    Jul 2011
    Posts
    157
    Thanks
    3

    Re: Markov Chain Transition Probabilities Help.

    Hi

    First you form a matrix P (dimensions k x k where k is the number of possible states) with entries p_{i,j}= the probability of going from state i to state j in one step. Then if you raise the matrix to the power of n, the entry of the final matrix in the ith row and jth column will be the probability of going from state i to state j in exactly n steps. If you want to get the probability of going from state i to step j in at most n steps, then you need to get the entry from the ith row and the jth column of the matrix:

    S=P+P^2+\cdots+P^n=\left ( P^{n+1}-P \right )\cdot\left ( P-I \right )^{-1}
    Thanks from chloe08276
    Follow Math Help Forum on Facebook and Google+

  3. #3
    Newbie
    Joined
    Sep 2012
    From
    Sheffield
    Posts
    2

    Re: Markov Chain Transition Probabilities Help.

    That is exactly what I was looking for! Thanks so much.
    Follow Math Help Forum on Facebook and Google+

  4. #4
    Member anonimnystefy's Avatar
    Joined
    Jul 2011
    Posts
    157
    Thanks
    3

    Re: Markov Chain Transition Probabilities Help.

    You are welcome.
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Markov chain transition matrix
    Posted in the Advanced Statistics Forum
    Replies: 4
    Last Post: May 18th 2009, 10:08 PM
  2. Markov chain transition matrix
    Posted in the Advanced Statistics Forum
    Replies: 3
    Last Post: May 15th 2009, 02:52 AM
  3. Transition matrix for Markov chain
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: May 8th 2009, 03:04 AM
  4. Markov Chains & Transition Probabilities
    Posted in the Advanced Statistics Forum
    Replies: 5
    Last Post: April 26th 2009, 02:41 AM
  5. Markov Chain (transition matrix)
    Posted in the Advanced Statistics Forum
    Replies: 1
    Last Post: March 14th 2009, 12:05 AM

Search Tags


/mathhelpforum @mathhelpforum