Noise in a communication channel flips bits at ran$-$

dom with probability P$.$ Argue that the entropy

associated with this process is

S $=$P log P $(1$ P$)$ log$(1$ P$).(15\mathrm{.}29)$

It turns out that the rate R at which we can pass

information along this noisy channel is $1$S$.$