Problem 2 - Information Theory Consider the following channel 012 07 a) Calculate entropy of...
Fantastic news! We've Found the answer you've been seeking!
Question:
Transcribed Image Text:
Problem 2 - Information Theory Consider the following channel 012 07 • a) Calculate entropy of X, i.c., H(X) when [p(x1), p(r2) = [0.6,0.4). Give p(r1) and p(x2) that maximize H(X) and the corresponding maximum value of H(Xx). • b) Give the matrix of transition probabilities [p(Y|X)]. • c) Calculate output probabilities [p(Y)]. • d) Give output probabilities so that H(Y) is maximum. For this case, then give equations with which you can calculate p(r) and p(r2). he SNR is 20 dB, whereas channel bandwidth is 30 KHz, • e) Calculate Shannon channel capacity in bits/sec. • ) The channel capacity of a binary symmetric channel is given by C = 1- H(p), where H(p) = -ploga(p) – (1 – p) log2(1 – p). Calculate C for p = 0, 0.5, and 1. Sketch C as a function of ; (Hint: Use lim,0 T log,(x) = 0.] р. Problem 2 - Information Theory Consider the following channel 012 07 • a) Calculate entropy of X, i.c., H(X) when [p(x1), p(r2) = [0.6,0.4). Give p(r1) and p(x2) that maximize H(X) and the corresponding maximum value of H(Xx). • b) Give the matrix of transition probabilities [p(Y|X)]. • c) Calculate output probabilities [p(Y)]. • d) Give output probabilities so that H(Y) is maximum. For this case, then give equations with which you can calculate p(r) and p(r2). he SNR is 20 dB, whereas channel bandwidth is 30 KHz, • e) Calculate Shannon channel capacity in bits/sec. • ) The channel capacity of a binary symmetric channel is given by C = 1- H(p), where H(p) = -ploga(p) – (1 – p) log2(1 – p). Calculate C for p = 0, 0.5, and 1. Sketch C as a function of ; (Hint: Use lim,0 T log,(x) = 0.] р.
Expert Answer:
Answer rating: 100% (QA)
entaopy HCx Plxi tog bits symbol 3D Given pea P6 06104 Pa1 06 i Pb 04 HX ... View the full answer
Related Book For
Posted Date:
Students also viewed these mechanical engineering questions
-
Evaluate the ease with which you can make hotel reservations using Fairmonts (www.fairmont.com) Internet reservation system. Check out the hotels privacy policy. Are you comfortable with their use of...
-
Add The Graph Of Y = 2 - X To The Plot From The Data Below. X Y
-
Given the following transition matrix with states 1 and 2 as absorbing states, what is the probability that unit in states 3 and 4 end up in each of the absorbingstates? 1.0 0.0 0.0 0.0 0.0 1.0 0.0...
-
In the Walton Bookstore example with a discrete demand distribution, explain why an order quantity other than one of the possible demands cannot maximize the expected profit.
-
What is the price of the August 2003 Treasury bond (assume a $100,000 par value) with the yield to maturity from the table? Verify the current yield. Why is the current yield higher than the yield...
-
What are the pros and cons of decisions made by groups such as committees and task forces as compared to decisions made by one person?
-
Think of a manager for whom you have worked. What did the manager do to promote job satisfaction among the employees in the organization?
-
What is component depreciation, and when must it be used?
-
"Discuss the key challenges and opportunities that technology advancement presents in the field of Operations Management. How can organizations effectively integrate new technologies into their...
-
The first Brillouin zone of an infinite chain of H atoms has an infinite number of crystal orbitals, each with a different value of k. (a) State the limiting values of k within the first Brillouin...
-
Gatterman-Koch reaction shown below is used to attach a formyl (-CHO) group to benzene or alkyl substituted benzenes. CH CO, HCI AICI; Gatterman Koch formylation CH However, aromatic aldehydes can be...
-
How many hats must Anthony sell to break even if his supplier raises the price of the hats to $ 2 1 per hat?
-
Suppose that you are given the following information. Total overhead is $ 6 0 , 0 0 0 . Of this, $ 4 0 , 0 0 0 is "machining," $ 1 0 , 0 0 0 is assembly." The machining cost pool is best driven by...
-
Indicate in which section of the balance sheet each of the accounts would be classified. Put parentheses around the account used if it represents a contra account. If the account does not appear on...
-
what ways do critical approaches interrogate the politics of knowledge production, and how does this interrogation affect the validation and dissemination of knowledge within academic and...
-
Your CFO has asked you to analyze the attached financial statements. In addition, you are provided the following information: Cost of debt 7% Cost of equity 20% Tax rate 25% FCF Terminal Growth Rate...
-
GE Industries is planning on merging with NM Industries GE Industries will pay NM Industries shareholders the current value of their stock in shares of GE Industries. GE Industries currently has...
-
Pearl Medavoy will invest $10,240 a year for 20 years in a fund that will earn 10% annual interest. . If the first payment into the fund occurs today, what amount will be in the fund in 20 years? If...
-
Which of the indicators in Fig could be used for doing the titrations in Exercises 62 and 64? Fig Pheadl Red
-
The sp2 hybrid atomic orbitals have the following general form: where Ïs, Ïpx, and Ïpy represent orthonormal (normalized and orthogonalized) atomic orbitals. Calculate the values of A...
-
Consider the autoionization of water at 25oC: H2O(l) H+(aq) + OH-(aq) Kw = 1.00 10-14 a. Calculate Go for this process at 25oC. b. At 40oC, Kw = 2.92 10-14. Calculate Go at 40oC.
-
Sales of automotive products for Ford Motor Company and General Motors Corporation for a five-year period are: Net sales for Pfizer Inc. and Abbott Laboratories for the same five years follow:...
-
Consider the following financial statements for Nixon Company. During the year, management obtained additional bond financing to enlarge its production facilities. The plant addition produced a new...
-
The following are the financial statements for Truman Company, with almost all dollar amounts missing: The following information is available about Truman Company's financial statements: 1. Quick...
Study smarter with the SolutionInn App