Problem 2 - Information Theory Consider the following channel 012 07 a) Calculate entropy of...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
Problem 2 - Information Theory Consider the following channel 012 07 • a) Calculate entropy of X, i.c., H(X) when [p(x1), p(r2) = [0.6,0.4). Give p(r1) and p(x2) that maximize H(X) and the corresponding maximum value of H(Xx). • b) Give the matrix of transition probabilities [p(Y|X)]. • c) Calculate output probabilities [p(Y)]. • d) Give output probabilities so that H(Y) is maximum. For this case, then give equations with which you can calculate p(r) and p(r2). he SNR is 20 dB, whereas channel bandwidth is 30 KHz, • e) Calculate Shannon channel capacity in bits/sec. • ) The channel capacity of a binary symmetric channel is given by C = 1- H(p), where H(p) = -ploga(p) – (1 – p) log2(1 – p). Calculate C for p = 0, 0.5, and 1. Sketch C as a function of ; (Hint: Use lim,0 T log,(x) = 0.] р. Problem 2 - Information Theory Consider the following channel 012 07 • a) Calculate entropy of X, i.c., H(X) when [p(x1), p(r2) = [0.6,0.4). Give p(r1) and p(x2) that maximize H(X) and the corresponding maximum value of H(Xx). • b) Give the matrix of transition probabilities [p(Y|X)]. • c) Calculate output probabilities [p(Y)]. • d) Give output probabilities so that H(Y) is maximum. For this case, then give equations with which you can calculate p(r) and p(r2). he SNR is 20 dB, whereas channel bandwidth is 30 KHz, • e) Calculate Shannon channel capacity in bits/sec. • ) The channel capacity of a binary symmetric channel is given by C = 1- H(p), where H(p) = -ploga(p) – (1 – p) log2(1 – p). Calculate C for p = 0, 0.5, and 1. Sketch C as a function of ; (Hint: Use lim,0 T log,(x) = 0.] р.
Expert Answer:
Answer rating: 100% (QA)
entaopy HCx Plxi tog bits symbol 3D Given pea P6 06104 Pa1 06 i Pb 04 HX ... View the full answer
Related Book For
Posted Date:
Students also viewed these mechanical engineering questions
-
Evaluate the ease with which you can make hotel reservations using Fairmonts (www.fairmont.com) Internet reservation system. Check out the hotels privacy policy. Are you comfortable with their use of...
-
Add The Graph Of Y = 2 - X To The Plot From The Data Below. X Y
-
Given the following transition matrix with states 1 and 2 as absorbing states, what is the probability that unit in states 3 and 4 end up in each of the absorbingstates? 1.0 0.0 0.0 0.0 0.0 1.0 0.0...
-
In the Walton Bookstore example with a discrete demand distribution, explain why an order quantity other than one of the possible demands cannot maximize the expected profit.
-
Manchester Partners International claims that 60% of the banking executives who lose their job stay in banking, whereas 40% leave banking. Suppose 40 people who have lost their job as banking...
-
Damage to the ________ disrupts ones ability to comprehend language, but it leaves ones ability to produce words intact. a. Amygdala b. Brocas Area c. Wernickes Area d. Occipital lobe
-
True or false: Peak-to-peak readings are used for displacement only.
-
It is now January. The current interest rate is 5%. The June futures price for gold is $946.30, whereas the December futures price is $960.00. Is there an arbitrage opportunity here? If so, how would...
-
Given: Azimuth FROM Point T to Point A = 106.3385 (decimal degrees) Point T X 539078.3526 = Y 167480.1292 = Point J == Turned Angle to the right = 56 degrees Distance = 25' B M
-
On December 31, 2021, the end of its first year of operations, Botani Associates owned the following securities that are held as long-term investments. On this date, the total fair value of the...
-
When Tina Trouse mentioned that the financial statements of Yarrow Co. were materially misstated. Which one of the following is the kind of audit opinion that would be issued? a. limitation of scope...
-
A world-class sprinter running a 100 m dash was clocked at 5.4 m/s 1.0 s after starting running and at 9.8 m/s 1.5 s later. In which of these time intervals, 0 to 1.0 s or 1.0 s to 2.5 s, was his...
-
Write a program that displays the following menu: If the user enters 1, the program should ask for the radius of the circle and then display its area. Use the following formula to calculate the...
-
Let \(f\) be a scalar function and \(\mathbf{F}\) be a vector field. Prove the following Product Rule for Divergence: \[ \operatorname{div}(f \mathbf{F})=f \operatorname{div}(\mathbf{F})+abla f \cdot...
-
Thin Co. is a private hospital offering three types of surgical procedure known as A, B and C. Each of them uses a pre-operative injection given by a nurse before the surgery. Thin Co. currently rent...
-
Calculate the stock price of OSE Water Co. if the difference between the required rate of return on this investment and the expected growth rate of dividends is 3.6% and dividends per share are...
-
Consider the following actual FY2019 data and a forecast of FY2020 selected balance sheet and income statement numbers. $ millions FY2019 Actual FY2020 Est. $29,009 $32,102 14,592 16,051 8,755 9,923...
-
Arlington Merchants reported the following on its income statement for the fiscal years ending December 31, 2016 and 2015. 2016 2015 Sales $4,857,500 $4,752,900 Cost of goods sold 3,258,950 3,207,000...
-
Which of the indicators in Fig could be used for doing the titrations in Exercises 62 and 64? Fig Pheadl Red
-
The sp2 hybrid atomic orbitals have the following general form: where Ïs, Ïpx, and Ïpy represent orthonormal (normalized and orthogonalized) atomic orbitals. Calculate the values of A...
-
Consider the autoionization of water at 25oC: H2O(l) H+(aq) + OH-(aq) Kw = 1.00 10-14 a. Calculate Go for this process at 25oC. b. At 40oC, Kw = 2.92 10-14. Calculate Go at 40oC.
-
Describe how framing heuristics affect a managers escalation of commitment.
-
You have 100 doses of a vaccine against a deadly strain of influenza that is sweeping the country, with no prospect of obtaining more. Standing in line are 100 schoolchildren and 100 elderly people....
-
Discuss what is meant by the term stress management and available interventions for organizations and individuals.
Study smarter with the SolutionInn App