analyzed a minimum-MSE quantizer for a pdf in which fulu) = f over an interval of...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
analyzed a minimum-MSE quantizer for a pdf in which fulu) = f₁ over an interval of |size L₁, fulu) = f₂ over an interval of size L₂, and fu(u) = 0 elsewhere. Let M be the total number of representation points to be used, with M₁ in the first interval and M₂ = M - M₁ in the second. Assume (from symmetry) that the quantization intervals are of equal size A₁ = L₁/M₁ in interval 1 and of equal size A₂ = L₂/M₂ in interval 2. Assume that Mis very large, so that we can approximately minimize the MSE over M₁, M₂ without an integer constraint on M₁, M₂ (that is, assume that M₁, M₂ can be arbitrary real numbers). (a) Show that the MSE is minimized if A₁f1/³ = ₂2/3, -1/3 i.e. the quantization interval sizes are inversely proportional to the cube root of the density. [Hint. Use a Lagrange multiplier to perform the minimization. That is, to minimize a function MSE(A1, A2) subject to a constraint M = f(A₁,A2), first minimize MSE(A₁, A₂) + AfA1, A₂) without the constraint, and, second, choose A so that the solution meets the constraint.] (b) Show that the minimum MSE under the above assumption is given by 3 (L₁ƒ 1/³ +4₂₁ƒ2/³)³ 2√2² 12M² MSE = (c) Assume that the Lloyd-Max algorithm is started with 0 < M₁ < M representation points in the first interval and M₂ = M - M₁ points in the second interval. Explain where the Lloyd- Max algorithm converges for this starting point. Assume from here on that the distance between the two intervals is very large. (d) Redo part (c) under the assumption that the Lloyd-Max algorithm is started with 0 < M₁ < M - 2 representation points in the first interval, one point between the two intervals, and the remaining points in the second interval. (e) Express the exact minimum MSE as a minimum over M-1 possibilities, with one term for each choice of 0 < M₁ < M. (Assume there are no representation points between the two intervals.) (f) Now consider an arbitrary choice of A₁ and A₂ (with no constraint on M). Show that the entropy of the set of quantization points is given by H(V)=-f₁L, log(f₁A₁) -f₂L₂ log(f₂4₂). (g) Show that if the MSE is minimized subject to a constraint on this entropy (ignoring the integer constraint on quantization levels), then A₁ = A₂. * 2 1 1 1 1 S 1 LC analyzed a minimum-MSE quantizer for a pdf in which fulu) = f₁ over an interval of |size L₁, fulu) = f₂ over an interval of size L₂, and fu(u) = 0 elsewhere. Let M be the total number of representation points to be used, with M₁ in the first interval and M₂ = M - M₁ in the second. Assume (from symmetry) that the quantization intervals are of equal size A₁ = L₁/M₁ in interval 1 and of equal size A₂ = L₂/M₂ in interval 2. Assume that Mis very large, so that we can approximately minimize the MSE over M₁, M₂ without an integer constraint on M₁, M₂ (that is, assume that M₁, M₂ can be arbitrary real numbers). (a) Show that the MSE is minimized if A₁f1/³ = ₂2/3, -1/3 i.e. the quantization interval sizes are inversely proportional to the cube root of the density. [Hint. Use a Lagrange multiplier to perform the minimization. That is, to minimize a function MSE(A1, A2) subject to a constraint M = f(A₁,A2), first minimize MSE(A₁, A₂) + AfA1, A₂) without the constraint, and, second, choose A so that the solution meets the constraint.] (b) Show that the minimum MSE under the above assumption is given by 3 (L₁ƒ 1/³ +4₂₁ƒ2/³)³ 2√2² 12M² MSE = (c) Assume that the Lloyd-Max algorithm is started with 0 < M₁ < M representation points in the first interval and M₂ = M - M₁ points in the second interval. Explain where the Lloyd- Max algorithm converges for this starting point. Assume from here on that the distance between the two intervals is very large. (d) Redo part (c) under the assumption that the Lloyd-Max algorithm is started with 0 < M₁ < M - 2 representation points in the first interval, one point between the two intervals, and the remaining points in the second interval. (e) Express the exact minimum MSE as a minimum over M-1 possibilities, with one term for each choice of 0 < M₁ < M. (Assume there are no representation points between the two intervals.) (f) Now consider an arbitrary choice of A₁ and A₂ (with no constraint on M). Show that the entropy of the set of quantization points is given by H(V)=-f₁L, log(f₁A₁) -f₂L₂ log(f₂4₂). (g) Show that if the MSE is minimized subject to a constraint on this entropy (ignoring the integer constraint on quantization levels), then A₁ = A₂. * 2 1 1 1 1 S 1 LC
Expert Answer:
Related Book For
Income Tax Fundamentals 2013
ISBN: 9781285586618
31st Edition
Authors: Gerald E. Whittenburg, Martha Altus Buller, Steven L Gill
Posted Date:
Students also viewed these accounting questions
-
Jackson County Senior Services is a nonprofit organization devoted to providing essential services to seniors who live in their own homes within the Jackson County area. Three services are provided...
-
The following additional information is available for the Dr. Ivan and Irene Incisor family from Chapters 1-5. Ivan's grandfather died and left a portfolio of municipal bonds. In 2012, they pay Ivan...
-
3. Given the following information: Quantity Average Fixed Cost Average Variable Cost Average Total Cost Marginal Cost 1 300 100 400 100 2 150 75 225 50 3 100 70 170 60 4 75 73 148 80 5 60 80 140 110...
-
You are the newly appointed financial manager of The Shoebox (Pty) Ltd, which operates a chain of 20 large retail shoe stores in and around Port Elizabeth, selling on a cash-only basis. The stores...
-
What is a greenschist or greenstone? (See Fig. 6.5.)
-
The completed financial statement columns of the work sheet for Bray Company are available. Instructions (a) Prepare an income statement, a statement of owner's equity, and a classified balance...
-
To test whether radio signals from deep space contain a message, an interval of time could be subdivided into a number of very short intervals and it could then be determined whether the signal...
-
In October 2012, the top management of Southern Recreational Vehicle Company of St. Louis, Missouri, announced its plans to relocate its manufacturing and assembly operations to a new plant in...
-
Cost overruns and extraordinary spending by healthcare organizations harms the sustainability of the healthcare organization. Through activity-based costing (ABC), the healthcare industry is working...
-
Marcella, who is from Toledo, Ohio, drives to Troy, Michigan, and shops at a popular mall. When leaving the parking lot, Marcella causes a car accident when she runs a stop sign. 1. What is the name...
-
You are the VP of Marketing for Wal-Mart and have been asked to recommend whether Wal-Mart should invest $100 million in new Wal-Mart Stores in the Eastern United States OR invest the same amount in...
-
Mr Lambert is planning for his retirement in the years to come when he will reach 6 0 . He wants to spend $ 9 0 0 0 at the end of each year during his retirement period which he has estimated to be 1...
-
Would the allocation method create internal conflict between the managers of the hotel, restaurant, and casino? Do you see any advantages in allocating the fixed costs to the segments?
-
Accountant 15 is the audit partner of the st louis office. He is concerned because a client is now suing the st louis office. What should he do with the audit client? Can he still do the audit?
-
Use the following income statement and balance sheet information to put together a statement of cash flows. (Enter negative amounts using either a negative sign preceding the number e.g. -45 or...
-
Can you describe: 1. Distributed bus arbitration using self selection with pros and cons. 2. Daisy chain arbitration with pros and cons. 3. Centralized parallel bus arbitration with pros and cons. 4....
-
Which of the following is correct regarding a wave in the open ocean? O all of the above O such waves are called waves of oscillation O the wave form moves forward but the water particles do not...
-
The following exercises are not grouped by type. Solve each equation. x610x -9
-
Emily Jackson (Social Security number 765-12-4326) and James Stewart (Social Security number 466-74-9932) are partners in a partnership that owns and operates a barber shop. The partnership's first...
-
Ken (age 31) and Amy (age 28) Booth have brought you the following information regarding their income, expenses, and withholding for the year. They are unsure which of these items must be used to...
-
Tom has a successful business with $100,000 of income in 2012. He purchases one new asset in 2012, a new machine which is 7-year MACRS property and costs $25,000. If you are Tom's tax advisor, how...
-
Is leadership synonymous with management, or is leading just one of the many things that a manager does? In what ways are they the same or different?
-
Explain Blake and Moutons Leadership Grid in relationship to previous leadership research.
-
Write a description of an effective manager. Write words that you would use to describe an effective leader. When you review your list, consider the differences and similarities in your adjectives....
Study smarter with the SolutionInn App