Results 1 to 4 of 4

Thread: Calculate conditional entropy

  1. #1
    Newbie
    Joined
    Jun 2017
    From
    Home
    Posts
    2

    Calculate conditional entropy

    Hello,

    I have this information:

    P(a, 1) = 0,4
    P(a, 2) = 0,1
    P(a, 3) = 0,05
    P(a, 4) = 0,1

    P(b, 1) = 0,05
    P(b, 2) = 0,1
    P(b, 3) = 0,3
    P(b, 4) = 0,1

    We have X1(x, y) = x and X2(x, y) = y so P(X2 = 1) = P({(a, 1); (b, 1)})

    How can I Calculate H(X), H(Y) and H(Y|X)?
    Follow Math Help Forum on Facebook and Google+

  2. #2
    MHF Contributor
    Joined
    Nov 2010
    Posts
    2,706
    Thanks
    1033

    Re: Calculate conditional entropy

    What does your book say to do? Where are you getting confused? How can we help clarify if you do not tell us what part you do not understand.
    Follow Math Help Forum on Facebook and Google+

  3. #3
    Newbie
    Joined
    Jun 2017
    From
    Home
    Posts
    2

    Re: Calculate conditional entropy

    I missed the course so I'm not so sure. I think I have to use this:

    Calculate conditional entropy-formel.jpg

    Im not sure how I can use this with my numbers.
    what would be the next step?

    An Example would be helpful it doesn't have to be my example.
    Thanks in advance
    Follow Math Help Forum on Facebook and Google+

  4. #4
    MHF Contributor
    Joined
    Nov 2010
    Posts
    2,706
    Thanks
    1033

    Re: Calculate conditional entropy

    Ok, so what is $X$ and what is $Y$?
    Last edited by SlipEternal; Jun 5th 2017 at 11:25 AM.
    Follow Math Help Forum on Facebook and Google+

Similar Math Help Forum Discussions

  1. Conditional entropy question
    Posted in the Statistics Forum
    Replies: 0
    Last Post: May 25th 2012, 08:20 PM
  2. conditional entropy of function
    Posted in the Advanced Statistics Forum
    Replies: 1
    Last Post: May 3rd 2012, 03:33 PM
  3. Replies: 0
    Last Post: Aug 3rd 2010, 07:02 PM
  4. Entropy
    Posted in the Discrete Math Forum
    Replies: 2
    Last Post: Oct 6th 2008, 10:48 AM
  5. Entropy
    Posted in the Advanced Applied Math Forum
    Replies: 4
    Last Post: Dec 27th 2007, 04:58 AM

/mathhelpforum @mathhelpforum