Question: 3 (13 points-Correctness) Entropy and expected coding length (a) (2 points-Correctness) Consider the following two distributions defined by the counts below, where the numbers represent
3 (13 points-Correctness) Entropy and expected coding length (a) (2 points-Correctness) Consider the following two distributions defined by the counts below, where the numbers represent the counts of 5 different values of a random variable. Distribution 1: (1,4,5,3,2) Distribution 2: (2,2,39,8,1) Which of the above two distributions has a higher entropy and why? You should NOT give the numerical entropy here (though you are welcome to compute it to check that your reasoning matches the math). Your explanation should be a qualitative argument. points- Correctness) Calculate the entropy for the given distribution. Show your work for full credit. Counts 12 (c) (4 points-Correctness) Consider a text file with the following content: nnnnaameemmmnnamamnn Find the expected length (number of bits) of a coded symbol under each of the following coding schemes, using the distributions of the symbols in the above file. Show your work for ull credit. Coding Scheme 1 Coding Scheme 2 CodeWord Symbol CodeWord Symbo 00 n 01 a 10 m 11 e 110 101
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
