Problem
Answer the Following Questions About Optimization:
A. What are the steps in iterative optimization algorithms?
a. Check for convergence. What is a criteria?
b. Choose a step direction. What algorithm uses -gk(x)?
c. Choose a step size ?. (i.e. via a line search)
d. Compute the new coordinates (be able to write the formula).
B. What are "Quasi-Newton" optimization methods and what are their advantages compared to a Newton method?