Question: Bonus 2. Using a standard (balanced) die, the following sequence of numbers is rolled : 2, 4, 1, 3. Compute the amount of information in

Bonus

2. Using a standard (balanced) die, the following sequence of numbers is rolled : 2, 4, 1, 3. Compute the amount of information in bits for this event (i.e. the minimal amount of information required to store this sequence). (10 points)

3. Consider two die, one being balanced, i.e. the probability of each of the 6 numbers is equal, and one which is loaded where the probability of 2 is 0.2, the probability of 6 is 0.4, and the probability of the other numbers are equal. Compute the entropy an event produced by each of the two dice. (10 points)

4. The entropy of a probability distribution is 3.6 bits. Is this enough information to calculate how many Hartleys the entropy of the same distribution is? If it can be calculated, how many Hartleys is it? How would the answer change if we were asking about nat-s? (10 points)

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!