# Question: Suppose a source sends symbols from a three letter alphabet

Suppose a source sends symbols from a three letter alphabet with X Ɛ {a, b, c} and Pa = 1/ 2, Pb = 1/ 4, Pc = 1/ 4 are the source symbol probabilities.

(a) Determine the entropy of this source.

(b) Give a source code that has an average codeword length that matches the entropy.

(a) Determine the entropy of this source.

(b) Give a source code that has an average codeword length that matches the entropy.

## Answer to relevant Questions

Suppose a random variable, X, has N = 2n equally likely outcomes. What is the entropy of X in bits? Suppose X is a Gaussian random variable with a mean of µ and a variance of σ2 ( i. e., X ~ N( µ, σ2)). Find an expression for E [|X|]. Find an expression for the even moments of a Rayleigh random variable. That is, find E [Y2m] for any positive integer m if the random variable, Y , has a PDF given by Find the mean of the random variables described by each of the following probability mass functions: (a) (b) (c) (d) Find the variance and coefficient of skewness for a Poisson random variable whose PMF isPost your question