Question: 1. Consider a process (A) that generates one of the following characters every second A-Z, az, 0-9, $, or %. a. Characters 0.9 A-Z az,

1. Consider a process (A) that generates one of the following characters every second A-Z, az, 0-9, $, or %. a. Characters 0.9 A-Z az, $, % Probability of one of the characters 1/16 1/(8*26) 1/(4*28) What is the Entropy of this system? You can do it by hand or use a spreadsheet or code. Please describe or show your work b. If each character is equally likely, what's the Entropy of the process's output? Now, consider process B that generates two characters uniformly randomly every two seconds to generate a two-character message, e.g. ZY or CC. What's the entropy of each two character message? What's its relationship to your answer in part b and why? c. 1. Consider a process (A) that generates one of the following characters every second A-Z, az, 0-9, $, or %. a. Characters 0.9 A-Z az, $, % Probability of one of the characters 1/16 1/(8*26) 1/(4*28) What is the Entropy of this system? You can do it by hand or use a spreadsheet or code. Please describe or show your work b. If each character is equally likely, what's the Entropy of the process's output? Now, consider process B that generates two characters uniformly randomly every two seconds to generate a two-character message, e.g. ZY or CC. What's the entropy of each two character message? What's its relationship to your answer in part b and why? c
Step by Step Solution
There are 3 Steps involved in it
Get step-by-step solutions from verified subject matter experts
