Compare and contrast internal and external validity

Question

Warm-up Activity

Download G*Power and play around with it. See how changes in assumptions and parameters affect sample size estimates.

Part 1

1. Compare and contrast internal and external validity. Describe and give examples of research questions for which external validity is a primary concern. Describe and give examples of research questions in which internal validity is a primary concern. Discuss strategies researchers use in order to make strong claims about the applicability of their findings to a target population.
2. Compare and contrast random selection and random assignment. Be sure to include a discussion of when you would want to do one or the other and the possible consequences of failing to do random selection or random assignment in particular situations.
3. Explain the relationship between sample size and the likelihood of a statistically significant difference between measured values of two groups. In other words, explain why, all else being equal, as sample size increases the likelihood of finding a statistically significant relationship increases.
4. Compare and contrast probability and non-probability sampling. What are the advantages and disadvantages of each?

Part 2
If you do a quantitative study for your dissertation, you must estimate the sample size you will need in order to have a reasonable chance of finding a relationship among the variables stated in your research hypotheses (should one exist), given your statistical analysis(es) and assumptions/calculations of factors 2-4 above. You must do this, even if you plan to use a convenience sample (see below). There are a number of sample size calculators available. Northcentral uses G*Power, which is required in this Activity. You will use G*Power's "a priori power analysis" function to calculate a sample size. If it yields an unrealistically large size sample, you will rethink your design and assumptions and, perhaps, use G*Power's "compromise power analysis" to estimate a workable sample size that makes sense. If you plan on using a convenience sample, you would use both analyses as part of your argument that your convenience sample is large enough.