Are there any summation bounds given?
can anyone show me the proof how the logarithmic series on the left becomes the expression on the right hand side . kindly see the attached file..Thanks in advance for any help.
You are interested in messages of length in an alphabet with symbols, there are such messages.
Then as by assumption each message is equally likely:
So the entropy becomes: