Problem
1. Explain how you can evaluate your boolean query system.
2. Now consider the case where the output of your boolean query system is going to be re-ranked and only the top 10 results displayed. Explain how you could evaluate this combined boolean query and re-ranking system.
Your answers to both (1) and (2) should at a minimum consider:
1. What data you would need (e.g. queries and ground truth);
2. The challenges that you would have to face getting this data;
3. What metrics are appropriate, and why these metrics are appropriate.