Problem
1) Explain how reinforcement learning concepts apply to the cartpole problem.
a) What is the goal of the agent in this case?
b) What are the various state values?
c) What are the possible actions that can be performed?
d) What reinforcement algorithm is used for this problem?
2) Analyze how experience replay is applied to the cartpole problem.
a) How does experience replay work in this algorithm?
b) What is the effect of introducing a discount factor for calculating the future rewards?
3) Analyze how neural networks are used in deep Q-learning.
a) Explain the neural network architecture that is used in the cartpole problem.
b) How does the neural network make the Q-learning algorithm more efficient?
c) What difference in the algorithm performance when increasing or decreasing the learning rate?