# Math Help - Conditional Probability/Restrictions

1. ## Conditional Probability/Restrictions

I'm looking to get some insight into a moderately challenging conditional probability problem:

Consider a sequence of random variables $X_1$, $X_2$..., $X_n$ which each take the values 0 and 1. Assume that
Pr( $X_j$ = 1) = 1 - Pr( $X_{j-1}$= 0) = $\phi$, $\hspace{5mm}$j =1,...,n

where 0 < $\phi$ < 1 and that

$\hspace{10mm}$Pr( $X_j$ = 1| $X_{j-1}$=1) = $\lambda$, $\hspace{5mm}$j = 2,...,n.

(a) Find Pr( $X_j$= 0| $X_{j-1}$=1), Pr( $X_j$= 1| $X_{j-1}$=0),Pr( $X_j$ = 0| $X_{j-1}$=0).
(b) Find the requirements on $\lambda$ so that this describes a valid probability distribution for $X_1$, $X_2$..., $X_n$.

So for part (a) I have: 1- $\lambda$, $\phi$, and 1- $\phi$, respectively.
I do not know how to begin part (b).

2. ## Re: Conditional Probability/Restrictions

For part (a), you may have some mistakes. Here is what I get:

$\mbox{Pr}(X_{j-1}=1) = \phi$

$\mbox{Pr}(X_{j-1}=0) = 1-\mbox{Pr}(X_{j-1}=1) = 1-\phi$

$\mbox{Pr}(X_j=1|X_{j-1}=1) = \lambda = \dfrac{\mbox{Pr}((X_j=1)\cap (X_{j-1}=1))}{\mbox{Pr}(X_{j-1}=1)} = \dfrac{\mbox{Pr}((X_j=1)\cap (X_{j-1}=1))}{\phi}$ implies

$\mbox{Pr}((X_j=1)\cap (X_{j-1}=1)) = \lambda\phi$

$\mbox{Pr}(X_j=0|X_{j-1}=1) + \mbox{Pr}(X_j=1|X_{j-1}=1) = 1$ so I agree that $\mbox{Pr}(X_j=0|X_{j-1}=1) = 1-\lambda$.

But, $\mbox{Pr}(X_j=1|X_{j-1}=0) = \dfrac{\mbox{Pr}((X_j=1)\cap (X_{j-1}=0))}{\mbox{Pr}(X_{j-1}=0)} = \dfrac{\mbox{Pr}((X_j=1)\cap (X_{j-1}=0))}{1-\phi}$

Since $\phi = \mbox{Pr}(X_j=1) = \mbox{Pr}((X_j=1)\cap (X_{j-1}=0)) + \mbox{Pr}((X_j=1)\cap (X_{j-1}=1))$ $= \mbox{Pr}((X_j=1)\cap (X_{j-1}=0)) + \lambda\phi$, we find $\mbox{Pr}((X_j=1)\cap (X_{j-1}=0)) = \phi(1-\lambda)$

So, $\mbox{Pr}(X_j=1|X_{j-1}=0) = \dfrac{\mbox{Pr}((X_j=1)\cap (X_{j-1}=0))}{1-\phi} = \dfrac{\phi(1-\lambda)}{1-\phi}$

Then $\mbox{Pr}(X_j=0|X_{j-1}=0) = 1- \mbox{Pr}(X_j=1|X_{j-1}=0) = 1-\dfrac{\phi(1-\lambda)}{1-\phi} =$ $\dfrac{1-2\phi + \phi\lambda}{1-\phi}$

Let's check that we have everything correct:

So, based on this, we have

\begin{align*}\mbox{Pr}((X_j=1)\cap (X_{j-1}=0)) & = \phi(1-\lambda) \\ \mbox{Pr}((X_j=1)\cap (X_{j-1}=1)) & = \phi\lambda \\ \mbox{Pr}((X_j=0)\cap (X_{j-1}=0)) & = 1-2\phi + \phi\lambda \\ \mbox{Pr}((X_j=0)\cap (X_{j-1}=1)) & = \phi(1-\lambda)\end{align*}

3. ## Re: Conditional Probability/Restrictions

Thanks for the help.

Did you have any idea on the restrictions for $\lambda$?

Obviously the entire set has to be equal to a probability of 1. So are the bounds for $\lambda$ are 0 < $\lambda$ < 1?

4. ## Re: Conditional Probability/Restrictions

Originally Posted by ishihara
Thanks for the help.

Did you have any idea on the restrictions for $\lambda$?

Obviously the entire set has to be equal to a probability of 1. So are the bounds for $\lambda$ 0 < $\lambda$ < 1?
Let's check out all of the restrictions:

From $\mbox{Pr}((X_j=1)\cap (X_{j-1}=0)) = \phi(1-\lambda)$:

$0 \le \phi(1-\lambda) \le 1 \Rightarrow 0 \le 1-\lambda \le \dfrac{1}{\phi} \Rightarrow 1-\dfrac{1}{\phi} < 0 \le \lambda \le 1$

From $\mbox{Pr}((X_j=1)\cap (X_{j-1}=1)) = \phi\lambda$:

$0 \le \lambda\phi \le 1 \Rightarrow 0 \le \lambda \le 1 < \dfrac{1}{\phi}$

From $\mbox{Pr}((X_j=0)\cap (X_{j-1}=0)) = 1-2\phi + \phi\lambda$:

$0 \le 1-2\phi + \phi\lambda \le 1 \Rightarrow 2\phi-1 \le \phi\lambda \le 2\phi \Rightarrow 2-\dfrac{1}{\phi} \le \lambda \le 1 < 2$

This inequality gives a possible bound for $\lambda$. If $\dfrac{1}{2} < \phi < 1$, then $0 < 2-\dfrac{1}{\phi} < 1$.

The conditional probabilities all give the same bounds for $\lambda$, as well.

I don't know if there are any other restrictions to consider.