State the three motivating criteria that define information entropy. Try to express each in your own words? Suppose a coin is weighted such that, when it is tossed and lands on a table, it comes up heads 70% of the time. What is the entropy of this coin? Suppose a four-sided die is loaded such that, when tossed onto a table, it shows 1 20%, 2 25%, 3 25%, and 4 30% of the time. What is the entropy of this die?

Answer rating: 100% (QA)

The three motivating criteria that define information entropy are as follows 1 Uncertainty ... View the full answer