(a) Explain the concept of information and its sources. Discuss entro…

Question

(a) Explain the concept of information and its sources. Discuss entropy and the information Rate.

(b) For a lossless channel with m input symbols and m output symbols prove that $H(X) = H(Y) \text{ and } H(X|Y) = 0$ ( 10, 10 )