Question: The source S(a, b, c, d, e has the corresponding probabilities P (0.4, 0.18, 0.15, 0.14, 0.13) (a) Calculate the entropy for the source S.

 The source S(a, b, c, d, e has the corresponding probabilities

The source S(a, b, c, d, e has the corresponding probabilities P (0.4, 0.18, 0.15, 0.14, 0.13) (a) Calculate the entropy for the source S. (5 Marks) (b) Calculate the code words appropriate for the symbol S using Shannon-Fano Algorithm. Note: assign "O" to the higher probability side and "1" to the lower probability side of each combination operation. Calculate the average number of bits for code words generated by Shannon-Fano algorithm. (7 Marks) (c) Use the code words defined in part (b) to encode the message "cad". If the bitstream of the encoded message is received with one bit error in the first bit of the bitstream, determine the decoded message. (3 Marks) (d) The source S- fa, b, c, d, e) is assigned to the segments of the first interval in the following manner, where a -[0,0.4), b [0.4, 0.58), c [0.58, 0.73) d[0.73, 0.87), and e [0.87, 1). Show the divisions of the interval for arithmetic encoding of the message "bb". Suggest a code word in binary form produced by the encoding procedure. (10 Marks)

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!