Question: 7 . 1 Shannon entropy ( 6 points ) You have ( N = 1 0 ) different samples of a material. They

7.1 Shannon entropy (6 points)
You have \( N=10\) different samples of a material. They are supposed to have the same weight, but there's an odd one out. Your goal is to find which one is the odd one out, but all you have is a pan balance. You can load its sides with any number of samples, and it will tell you whether the left side weighs more, the right side weighs more, or they both weigh the same.
1. Find the optimal loading strategy that maximizes the information gain of a single measurement. Plot the information gain (in bits) for different loading strategies.
2. For the optimal strategy found above, how many measurements do you need to do on average to find the odd one out?
3. What would be the information gain of a single (optimal) measurement in the limit of \( N \rightarrow \infty \)?
7 . 1 Shannon entropy ( 6 points ) You have \ ( N

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!