Consider an N - letter source with probabilities, Pi, i = 1, 2, 3 N. The entropy

Question:

Consider an N - letter source with probabilities, Pi, i = 1, 2, 3€¦ N. The entropy of the source is given by

Prove that the discrete distribution that maximizes the entropy is a uniform distribution. Hint: You need to perform a constrained optimization since the source probabilities must form a valid probability mass function, and thus p1+ p2+€¦+ pN = 1.

Distribution
The word "distribution" has several meanings in the financial world, most of them pertaining to the payment of assets from a fund, account, or individual security to an investor or beneficiary. Retirement account distributions are among the most...