Question: 1. A binary source has probabilities p(0)=0.9 and p(1)=0.1 Calculate the entropy of this source. Construct a Huffman code of the second extension, and calculate

1. A binary source has probabilities p(0)=0.9 and p(1)=0.1

  • Calculate the entropy of this source.
  • Construct a Huffman code of the second extension, and calculate Lavgfor this code.
  • Construct a Huffman code of the third extension, and calculate Lavgfor this code.
  • Construct a Huffman code of the fourth extension, and calculate Lavgfor this code.
  • Comment on the average lengths, as compared to the source entropy.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Mathematics Questions!

Q:

Coding & Information Theory 4. (18%) (Entropy and Shannon-Fano Code) Given a sources with probabilities P: = 0.3, 0.2, 0.15, 0.15, 0.1, 0.1. (1) Calculate the entropy of S. (2) Find the word-lengths,...

Q:

This is a Coding & Information Theory question 4. (18%) (Entropy and Shannon-Fano Code) Given a source 5 with probabilities p; = 0.3, 0.2, 0.15 0.15, 0.1, 0.1 (1) Calculate the entropy of S. (2) Find...

Q:

Portray in words what transforms you would have to make to your execution to some degree (a) to accomplish this and remark on the benefits and detriments of this thought.You are approached to compose...

Q:

Briefly describe ASCII and Unicode and draw attention to any relationship between them. [3 marks] (b) Briefly explain what a Reader is in the context of reading characters from data. [3 marks] A...

Q:

ttth Suppose that the sequence of bags {Bn | n N} is recursively enumerated by the computable function e(n, x) = fn(x), [7 marks] Hence prove that the set of all recursive bags cannot be recursively...

Q:

A creative engineer suggests structuring the TLB so that not all the bits of the presented address need match to result in a hit. Suggest how this might be achieved, and what might be the costs and...

Q:

Suppose that R(A, B, C) is a relational schema with functional dependencies F = {A, B C, C B}. (i) Is this schema in 3NF? Explain. [2 marks] (ii) Is this schema in BCNF? Explain. [2 marks] (b)...

Q:

Prolog You are approached to compose a Prolog program to work with twofold trees. Your code shouldn't depend on any library predicates and you ought to expect that the mediator is running without...

Q:

Consider an operating system that uses hardware support for paging to provide virtual memory to applications. (a) (i) Explain how the hardware and operating system support for paging combine to...

Q:

Tasks The goal of the project is to complete the code for the NgramAnalyser, MarkovModel, ModelMatcher and MatcherController classes, as detailed below, and to add test code to a new JUnit test...

Q:

Two positively charged particles are placed near each other. What direction does the electrical force between them make the particles want to move? It makes the particles want to move closer...

Q:

A single loop consists of inductors (L1, L2 . . .), capacitors (C1, C2 . . .), and resistors (R1, R2 . . .) connected in series as shown, for example, in Figure a. Show that regardless of the...

Q:

In an efficient market t a compary announced sales of a nem product are liswer than eapected, what would you eapect to happen to the atsock price? A It would not change. 1 c It would decreale. %

Q:

17. If the position (m) of a person is given as x(t) = -4t + 16t answer the question below. Make sure you show all work and include correct units (a) (5 points) What is the position of the person at...