A Discrete Memoryless Source (DMS) X has four symbols $x_1$, $x_2$, $…

Question

A Discrete Memoryless Source (DMS) X has four symbols $x_1$, $x_2$, $x_3$, $x_4$ with probabilities $P(x_1) = 0.1$, $P(x_2) = 0.1$, $P(x_3) = 0.6$, $P(x_4) = 0.2$. The source emits one of four symbols once every milliseconds.

Calculate :

(i) The information content of each of these symbols. [10]

(ii) The total entropy and information rate. [10]