Suppose that you have a long sequence constructed by randomly choosing from the five characters a,b,c,d,e with respective probabilities 1/2, 1/6, 1/6, 1/12, 1/12.

 A. What is the entropy of this distribution? Use base 2 logarithms; this is information theory, not statistical mechanics also Find the Huffman code for this distribution.

 

Note: You will have to write small programs to do this quesiton (Code in R language is required for solution)

Answer rating: 100% (QA)

Given the alphabets abcd and e with probabilities 121616112 and 112 The entropy is given as therefo... View the full answer