Question: 1. How may "bits" of information (in the mean) are there in a dichotomy mouse choice
(a) with probabilities p = 0.99 , q = 1 - p = 0.01 (b) p = 1, q = 1 - p = 0?
2. Compute the value of I(1 : 2) and J(1, 2) for:
Prob. (x = 0|Hi) =qi Prob. (x = 1|Hi) = pi, pi + qi = 1, I = 1, 2,
The binomial distributions B(pi qi, n), =- pi + qi = 1, I = 1, 2.
The Poisson distribution with parameters mi, i = 1, 2.
The normal distributions N(ui, σ2), i = 1, 2, that is, the normal distributions with mean ui and variance σ2.
The normal distributions N(ui, σ2i), I = 1, 2.