The three cards
(a) One card is white on both faces; one is black on both faces; and one is white on one side and black on the other. The three cards are shuffled and their orientations randomized. One card is drawn and placed on the table. The upper face is black. What is the colour of its lower face? (Solve the inference problem.)
(b) Does seeing the top face convey information about the colour of the bottom face? Discuss the information contents and entropies in this situation. Let the value of the upper face's colour be u and the value of the lower face's colour be l. Imagine that we draw a random card and learn both u and l. What is the entropy of u, H(U)? What is the entropy of l, H(L)? What is the mutual information between U and L, I(U;L)?