Results 1 to 3 of 3

Math Help - Entropy Question: Prove H(X, X^2) = H(X)

  1. #1
    Newbie
    Joined
    Oct 2012
    From
    UK
    Posts
    2

    Angry Entropy Question: Prove H(X, X^2) = H(X)

    Hello,

    I've been struggling with this for the past few hours.

    Prove H(X, X^2) = H(X)

    I tried to expand it out using the formula but I'm not even sure what P(X, X^2) is.

    Can anyone help?
    Follow Math Help Forum on Facebook and Google+

  2. #2
    MHF Contributor
    Joined
    Sep 2012
    From
    Australia
    Posts
    3,794
    Thanks
    656

    Re: Entropy Question: Prove H(X, X^2) = H(X)

    Hey Pawsiness.

    How do you show that mutual information difference is zero? Maybe you can show us what you have written out.
    Follow Math Help Forum on Facebook and Google+

  3. #3
    Newbie
    Joined
    Oct 2012
    From
    UK
    Posts
    2

    Re: Entropy Question: Prove H(X, X^2) = H(X)

    We are not suppose to use the mutual information but instead expand using chain rule
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Conditional entropy question
    Posted in the Statistics Forum
    Replies: 0
    Last Post: May 25th 2012, 08:20 PM
  2. entropy
    Posted in the Advanced Statistics Forum
    Replies: 0
    Last Post: May 3rd 2012, 01:19 PM
  3. Replies: 0
    Last Post: August 3rd 2010, 07:02 PM
  4. Entropy
    Posted in the Discrete Math Forum
    Replies: 2
    Last Post: October 6th 2008, 10:48 AM
  5. Entropy
    Posted in the Advanced Applied Math Forum
    Replies: 4
    Last Post: December 27th 2007, 04:58 AM

Search Tags


/mathhelpforum @mathhelpforum