Question: 7 . 1 Shannon entropy ( 6 points ) You have ( N = 1 0 ) different samples of a material. They
Shannon entropy points
You have N different samples of a material. They are supposed to have the same weight, but there's an odd one out. Your goal is to find which one is the odd one out, but all you have is a pan balance. You can load its sides with any number of samples, and it will tell you whether the left side weighs more, the right side weighs more, or they both weigh the same.
Find the optimal loading strategy that maximizes the information gain of a single measurement. Plot the information gain in bits for different loading strategies.
For the optimal strategy found above, how many measurements do you need to do on average to find the odd one out?
What would be the information gain of a single optimal measurement in the limit of N rightarrow infty
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
