Alice is designing a miniature light sensor which will transmit measurements to her PC. The sensor...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
Alice is designing a miniature light sensor which will transmit measurements to her PC. The sensor can record one of six values S = {a,b,c,d,e,f}, with probability distribution p=[1/4, 1/8, 1/8, 1/4, 1/8, 1/8]. (i) Calculate the entropy of the source (ii) Having found the entropy of the source, and recalling that entropy refers to the "uncertainty" of a symbol showing up, calculate the uncertainty that the symbol that shows up is either in the set {a,b} or not. (iii) Find the prefix free code for this source using Shannon-Fano coding, calculate its average wordlength and discuss its relationship with the entropy (iv) Find two different optimal binary codes for this source using Huffman coding, calculate their average wordlengths and discuss their relationship with the entropy. (v) Alice wishes to explore all the possible prefix-free binary codes that can be used to encode the six values, using words of no more than 3 bits. Make a list of all the sets of parameters n₁, n2, n3 (i.e. numbers of words of lengths 1, 2, and 3 respectively) for which a suitable code exists. Discuss the relationship of this result with your findings in (iii) and (iv). Alice is designing a miniature light sensor which will transmit measurements to her PC. The sensor can record one of six values S = {a,b,c,d,e,f}, with probability distribution p=[1/4, 1/8, 1/8, 1/4, 1/8, 1/8]. (i) Calculate the entropy of the source (ii) Having found the entropy of the source, and recalling that entropy refers to the "uncertainty" of a symbol showing up, calculate the uncertainty that the symbol that shows up is either in the set {a,b} or not. (iii) Find the prefix free code for this source using Shannon-Fano coding, calculate its average wordlength and discuss its relationship with the entropy (iv) Find two different optimal binary codes for this source using Huffman coding, calculate their average wordlengths and discuss their relationship with the entropy. (v) Alice wishes to explore all the possible prefix-free binary codes that can be used to encode the six values, using words of no more than 3 bits. Make a list of all the sets of parameters n₁, n2, n3 (i.e. numbers of words of lengths 1, 2, and 3 respectively) for which a suitable code exists. Discuss the relationship of this result with your findings in (iii) and (iv). Alice is designing a miniature light sensor which will transmit measurements to her PC. The sensor can record one of six values S = {a,b,c,d,e,f}, with probability distribution p=[1/4, 1/8, 1/8, 1/4, 1/8, 1/8]. (i) Calculate the entropy of the source (ii) Having found the entropy of the source, and recalling that entropy refers to the "uncertainty" of a symbol showing up, calculate the uncertainty that the symbol that shows up is either in the set {a,b} or not. (iii) Find the prefix free code for this source using Shannon-Fano coding, calculate its average wordlength and discuss its relationship with the entropy (iv) Find two different optimal binary codes for this source using Huffman coding, calculate their average wordlengths and discuss their relationship with the entropy. (v) Alice wishes to explore all the possible prefix-free binary codes that can be used to encode the six values, using words of no more than 3 bits. Make a list of all the sets of parameters n₁, n2, n3 (i.e. numbers of words of lengths 1, 2, and 3 respectively) for which a suitable code exists. Discuss the relationship of this result with your findings in (iii) and (iv). Alice is designing a miniature light sensor which will transmit measurements to her PC. The sensor can record one of six values S = {a,b,c,d,e,f}, with probability distribution p=[1/4, 1/8, 1/8, 1/4, 1/8, 1/8]. (i) Calculate the entropy of the source (ii) Having found the entropy of the source, and recalling that entropy refers to the "uncertainty" of a symbol showing up, calculate the uncertainty that the symbol that shows up is either in the set {a,b} or not. (iii) Find the prefix free code for this source using Shannon-Fano coding, calculate its average wordlength and discuss its relationship with the entropy (iv) Find two different optimal binary codes for this source using Huffman coding, calculate their average wordlengths and discuss their relationship with the entropy. (v) Alice wishes to explore all the possible prefix-free binary codes that can be used to encode the six values, using words of no more than 3 bits. Make a list of all the sets of parameters n₁, n2, n3 (i.e. numbers of words of lengths 1, 2, and 3 respectively) for which a suitable code exists. Discuss the relationship of this result with your findings in (iii) and (iv).
Expert Answer:
Related Book For
Statistics For Business And Economics
ISBN: 9780321826237
12th Edition
Authors: James T. McClave, P. George Benson, Terry T Sincich
Posted Date:
Students also viewed these programming questions
-
1. Show all of your workings and drawings clearly. 2. Submit your homework as a pdf. The homework can be typed, written digitally or via pen and paper. Do ensure that the orientation of your...
-
The site http://virtualpiano.net features an online player piano. If you click on the Key Assist menu just above the piano keyboard, and then Keyboard Keys, you will see that each key is labelled...
-
An investment at 10.47% effective annual rate compounded monthly is equal to an annual percentage rate of: A. 10.99% B. 9.57% C. 10% D. None of the above If the one-year discount factor is 0.8333,...
-
Firm O purchased two items of business personalty this year. The first item cost $35,000 and has a five-year recovery period, and the second item cost $61,500 and has a seven-year recovery period....
-
Use XL Miner to generate a simple random sample of 10 records from the Excel file Banking Data.
-
What data did Semmelweis collect, and what was the significance of those data as related to performance improvement in the present-day hospital?
-
Suppose you are the victim of an identity thief who continues to use your identity and to ruin your credit rating after you have discovered the problem. What problems do you have in clearing your...
-
If the beginning retained earnings balance is $5,900, net income is $4,000, and ending retained earnings is $6,700, what is the amount of dividends paid?
-
2. A double-spool turbofan engine is used to power an aircraft flying at speed of 250 m/s at an altitude of 11,000 m, where ambient temperature is -50C and pressure is 22.7 kPa. As shown below, the...
-
An experiment was conducted to compare the effectiveness of three pain relievers. A one-way ANOVA was performed, and SSA and SSA/S were calculated. During the data collection, the gender of the...
-
What is a project manager? What skills, knowledge, and abilities are required for a project manager? What leads to a project manager's success? What is more important to a project's success; project...
-
Discuss and explain the agile idea of evolving, emerging, and adaptive scope Explain the use of the Kano chart in the agile context Introduce and explain the agile approach to and process for...
-
From a government (policymakers) perspective, apply the above two metrics cost-effectiveness and Quality of life to evaluate the current excessive health care spending. (b) What are the reasons why...
-
conduct Independent Research on the following topics: (1) Maslow's Hierarchy of Needs (2) Fredrick Herzberg's Motivator-Hygiene Theory (3) McGregor's "Theory X and Theory Y" (4) Hersey and Blanchard...
-
1. 'Liberal approaches to diversity management are nothing more than warm and fuzzy.' Discuss this in relation to non-discrimination legislation and organizational policies and practices. 2....
-
The FASB had three primary goals in developing the Codification: 1. Simplify user access by codifying all authoritative US GAAP in one spot. 2. Ensure that the codified content accurately represented...
-
I frequently use NY Times and CNN and am aware of Fox News but I never use it. I visit these sites, NY Times and CNN, a few times a week whenever I have to research something or see something on...
-
For two events, A and B, P(A) = .4, P(B) = .2, and P(A | B) = .6: a. Find P(A B). b. Find P(B | A).
-
Calculate SSE and s2 for each of the following cases: a. n = 20, SSyy = 95, SSxy = 50, 1 = .75 b. n = 40, y2 = 860, y = 50, SSxy = 2,700, 1 = .2 c. n = 10, (yi - )2 = 58, SSxy = 91, SSxx = 170
-
Traditionally, people protect themselves from mosquito bites by applying insect repellent to their skin and clothing. Research suggests that permethrin, an insecticide with low toxicity to humans,...
-
Which of the following does not occur in the small intestine? (a) Bile from the gall bladder breaks fats into small droplets. (b) Nutrients are absorbed into the body. (c) Proteins are broken down....
-
Which blood vessels are responsible for nutrient and waste exchange with tissues?
-
Trace the path of blood through the body, beginning with blood returning from the tissues to the heart. Be sure to name each of the chambers of the heart.
Study smarter with the SolutionInn App