In her paper, "Developing an Effective Metrics Program," Rosenberg described a group of "sample goals, questions and metrics. The goals are general and could be adapted with minor modifications to any project development. Questions are derived to quantify the goals. The metrics needed to provide the answers to the questions are then chosen and shown in italics."
Here is a goal from her paper, with associated questions and metrics:
GOAL: Examine the product quality from the point of view of the customer
QUESTION: What percentage of the modules exceed the structure / architecture guidelines?
METRIC: Size (such as LOC)
METRIC: Complexity (such as Oviedo's metric)
QUESTION: What modules are high risk?
METRIC: Complexity (such as Oviedo's metric) for each module
METRIC: Size (such as LOC) for each module
METRIC: Errors
Use your knowledge of measurement dysfunction to critique this set of questions and metrics. In particular
(a) If you collected these metrics, would they provide you with answers to the questions? Why or why not? What other information, if any, would you need?
(b) If you could answer these questions, could you accurately describe the quality from the point of view of the customer? Why or why not? What other information, if any, would you need?
(c) If you relied on these metrics, would any aspect of the project be systematically under-managed or mismanaged? Explain your thinking.