Results 1 to 3 of 3

Thread: Prove Bernoulli Process is Markov Chain

  1. #1
    Junior Member
    Joined
    Sep 2008
    Posts
    47

    Prove Bernoulli Process is Markov Chain

    Let $\displaystyle Z_1, Z_2, ...$ be a Bernoulli Process with success parameter p. Prove if

    $\displaystyle Y_0, Y_1,...$, where $\displaystyle Y_{k+1} = max(0, Y_k + 2Z_{k+1} - 1)$ for $\displaystyle k = 0,1,...$ and $\displaystyle Y_0 = 0$

    and

    $\displaystyle X_0, X_1,..$ where $\displaystyle X_{k+1} = Z_{k+1} + Z_k$ for $\displaystyle k = 0,1,...,$ and $\displaystyle X_0 = 0$

    are Markov chains.
    Follow Math Help Forum on Facebook and Google+

  2. #2
    Junior Member
    Joined
    Sep 2008
    Posts
    47
    Does anyone have any idea how to go about these?
    Follow Math Help Forum on Facebook and Google+

  3. #3
    Junior Member
    Joined
    Mar 2009
    Posts
    64
    $\displaystyle X_2 = Z_2 + Z_1$

    Let us suppose $\displaystyle X_2 = 1$ then, either $\displaystyle Z_2=1 \mbox{ and } Z_1=0 \mbox{or} Z_1=0 \mbox{ and } Z_2=1$ with 0.5 probability of each case.

    Given this, and knowing that $\displaystyle X_3 = Z_3 + Z_2$

    $\displaystyle P(X_3 = 1|X_2 = 1) = p*0.5 + (1-p)*0.5 = 0.5$

    However, if we know that $\displaystyle X_1 = Z_1 + Z_0 = 2$ we know that $\displaystyle Z_1 = 1$

    Taking this into account, we get that,$\displaystyle X_1 = 2$ and $\displaystyle X_2 = 1$, imply $\displaystyle Z_2 = 0$.

    Therefore,

    $\displaystyle P(X_3 = 1 | X_2 = 1, X_1 = 2) = p$

    It doesn't seem to be a Markov Chain
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Markov chain (prove period aperiodic)
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: Oct 21st 2011, 08:07 AM
  2. Continuous Time Markov Chain - Immigration-Birth Process
    Posted in the Advanced Statistics Forum
    Replies: 1
    Last Post: Sep 5th 2011, 07:00 AM
  3. Markov Chain: Branching Process
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: Dec 1st 2010, 09:21 PM
  4. how do i prove a markov chain is irreducible?
    Posted in the Advanced Statistics Forum
    Replies: 1
    Last Post: Oct 6th 2009, 03:27 PM
  5. Replies: 0
    Last Post: Mar 10th 2009, 11:29 AM

Search Tags


/mathhelpforum @mathhelpforum