Question: Problem 1 (CONDITIONING ENTROPY AND MUTUAL INFORMATION) (a) Let the three discrete random variables X, Y, Z be related by Z = X 7 Y,

image text in transcribed
Problem 1 (CONDITIONING ENTROPY AND MUTUAL INFORMATION) (a) Let the three discrete random variables X, Y, Z be related by Z = X 7 Y, Where X, Y E {0, . . . ,m 1}, and the subtraction is modulo m. 1. Compare H(X|Y) and H(Z). 2. When is H(X|Y) equal tO H(Z)? 3. Assume the equality condition you found in part (b) is indeed satised, and Z has uniform distribution over {0, . . . ,m 1}. What can you say about I(X; Y)? (b) If X, Y, and Z are joint random variables, prove the following inequalities and nd conditions for equality. 1. H(X, Y, Z) H(X,Y) g H(X, Z) H(X). 2. I(X;Z|Y) 2 I(Z;Y|X) 7112,10 +I(X;Z). (c) If X, Y, and Z are joint random variables, give examples of X, Y, and Z such that 1. I(X;Y|Z) I(X;Y)

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!

Related Book