Thread: Entropy Question: Prove H(X, X^2) = H(X)

1. Entropy Question: Prove H(X, X^2) = H(X)

Hello,

I've been struggling with this for the past few hours.

Prove H(X, X^2) = H(X)

I tried to expand it out using the formula but I'm not even sure what P(X, X^2) is.

Can anyone help?

2. Re: Entropy Question: Prove H(X, X^2) = H(X)

Hey Pawsiness.

How do you show that mutual information difference is zero? Maybe you can show us what you have written out.

3. Re: Entropy Question: Prove H(X, X^2) = H(X)

We are not suppose to use the mutual information but instead expand using chain rule