Suppose that we have the following three reference patterns and their targets:
Each pattern is equally likely.
i. Draw the network diagram for an ADALINE network with no bias that could be trained on these patterns.
ii. We want to train the ADALINE network with no bias using these patterns. Sketch the contour plot of the mean square error performance index.
iii. Find the maximum stable learning rate for the LMS algorithm.
iv. Sketch the trajectory of the LMS algorithm on your contour plot. Assume a very small learning rate, and start with all weights equal to zero. This does not require any calculations.