A group of psychologists once measured 60 different variables on a sample of schizophrenic people. Using theses 60 variables, they did 60 separate hypothesis tests of the mean (one mean for each of the 60 variables). Two of these tests were significant at the 5% level. Suppose that in REALITY all 60 null hypotheses are true.
a) What is the probability of rejecting any one specific test at the 5% significance level? (I'm asking you the pick just one hypothesis test. Then, you need to tell me the chance that if the experiment is repeated for just this one test, the new result will lead him or her to decide to reject the null hypothesis.)
b) Now suppose this group of psychologists repeats all 60 experiments. About how many of the 60 hypothesis tests do we expect will have a p-value ? .05?