# Calculate conditional entropy

Printable View

• Jun 5th 2017, 09:05 AM
hitomie
Calculate conditional entropy
Hello,

I have this information:

P(a, 1) = 0,4
P(a, 2) = 0,1
P(a, 3) = 0,05
P(a, 4) = 0,1

P(b, 1) = 0,05
P(b, 2) = 0,1
P(b, 3) = 0,3
P(b, 4) = 0,1

We have X1(x, y) = x and X2(x, y) = y so P(X2 = 1) = P({(a, 1); (b, 1)})

How can I Calculate H(X), H(Y) and H(Y|X)?
• Jun 5th 2017, 09:15 AM
SlipEternal
Re: Calculate conditional entropy
What does your book say to do? Where are you getting confused? How can we help clarify if you do not tell us what part you do not understand.
• Jun 5th 2017, 09:41 AM
hitomie
Re: Calculate conditional entropy
I missed the course so I'm not so sure. I think I have to use this:

Attachment 37728

Im not sure how I can use this with my numbers.
what would be the next step?

An Example would be helpful it doesn't have to be my example.
Thanks in advance
• Jun 5th 2017, 11:14 AM
SlipEternal
Re: Calculate conditional entropy
Ok, so what is \$X\$ and what is \$Y\$?