Assignment:
I. Example Research Scenario:
An organization wants to know if participants with varying levels of expertise (professionals, paraprofessionals, and nonprofessionals) improve their knowledge after completing a training program.
The organization collected demographic information: gender, age, type of training (professional, paraprofessional, or nonprofessional), location of the worksite (on-site or off-site) and years of experience.
A pre-training test of knowledge, a training program, and post-training test of knowledge was developed. Participants were tested, then participated in the three-week training program, and then were tested again.
The dataset also includes (1) a measure of participant confidence in knowledge and (2) a certification exam score.
The data are discipline-neutral. Therefore, part of your final project is to create a context for the research that is associated with your discipline or area of interest (e.g., training to assess mental health status; training to work with special education children; training to become a technician or consultant).
II. Codebook
Variable Information
|
Variable
|
Label
|
Measurement Scale
|
Category Name
|
|
ID
|
N/A
|
N/A
|
N/A
|
|
Gender
|
Gender
|
Nominal
|
1 = Male
2 = Female
|
|
age
|
Age in Years
|
Ratio
|
|
|
qualification
|
Professional Qualification
|
Nominal
|
1 = Professional
2 = Paraprofessional
3 = Nonprofessional
|
|
worksite
|
Location of Work
|
Nominal
|
1 = On-Site
2 = Off-Site
|
|
knowledge1
|
Level of knowledge before Training
|
Interval
|
N/A
|
|
knowledge2
|
Level of knowledge after Training
|
Interval
|
N/A
|
|
years
|
Years of Experience
|
Ratio
|
N/A
|
|
confidence
|
Confidence in knowledge
|
Interval
|
N/A
|
|
exam
|
Certification exam
|
Interval
|
N/A
|
III. Example Instructions
Overview
Your task is to review the dataset, formulate a context, and then use your knowledge of statistics to answer the example research questions and test hypotheses that will help the organization evaluate the effectiveness of the program.
Part I. Create your own context
Using the research scenario and variables identified in the codebook, create a "story" that describes the purpose and focus of the study. In a few paragraphs describe the intent of your investigation in the form of a problem background and purpose statement.
Part II. Describe your sample.
Generate frequency tables and bar charts for the nominal variables. Generate and interpret descriptive statistics of central tendency, variability, skewness, and kurtosis for the continuous (scale) variables. Generate frequency tables and histograms with the normal curve superimposed for each scale variable. Label your tables and graphs according to APA format. Conclude with a paragraph summarizing the demographic characteristics of this sample.
1. Gender (nominal)
2. Age (scale)
3. Qualification (nominal)
4. Worksite (nominal)
5. Knowledge1 (scale)
6. Knowledge2 (scale)
7. Years (scale)
8. Confidence (scale)
9. Exam (scale)
Part III. Describe relationships among the variables.
Select the variables that are measured on interval or ratio scales. Create a correlation matrix. Label the table according to APA format. Identify and discuss the strongest and weakest correlations.
Part IV. Answer any FIVE of the seven following example research questions.
Based on the research scenario and the data, restate the research question, formulate the hypothesis, conduct an analysis, and interpret the results for each of the following. Please use the 7 step hypothesis testing model for each analysis, including an APA-style conclusion statement interpreting the results and answering the research question.
1. Is there a significant difference in knowledge between on-site and off-site workers before they take the training?
2. Is there a significant increase in knowledge as a result of the training?
3. Do participants of different classifications (professional, paraprofessional, and nonprofessional) perform differently on the certification exam? Which group performs best?
4. What are the effects of gender and worksite location (on- or off-site) on level of confidence? In other words:
a. Is there a gender difference in confidence?
b. Does type of worksite experience affect confidence?
c. Is there an interaction between gender and worksite in their effect on confidence
5. After controlling for prior knowledge, is there a difference between professionals, paraprofessionals, and non-professionals in knowledge after the training?
6. Does age predict performance on the certification exam?
7. In addition to age, do any of the other variables (years of experience or confidence) improve the ability to predict performance on the certification exam?
Part V. Summarize your findings.
Synthesize the results of your five analyses. Include a brief summary of the sample characteristics and the major findings. Interpret the findings so that the organization's leaders will have an understanding of the similarities and differences in knowledge, and how effective the training program is in improving knowledge.
| ID |
Gender |
Age |
Qualification |
Worksite |
Knowledge1 |
Knowledge2 |
Years |
Confidence |
Exam |
| 1 |
1 |
43 |
1 |
2 |
47 |
49 |
7 |
25 |
85 |
| 2 |
2 |
45 |
1 |
2 |
44 |
42 |
9 |
30 |
90 |
| 6 |
1 |
29 |
1 |
1 |
34 |
37 |
3 |
22 |
59 |
| 13 |
1 |
42 |
1 |
1 |
32 |
40 |
2 |
25 |
70 |
| 15 |
2 |
38 |
1 |
1 |
41 |
41 |
3 |
26 |
79 |
| 17 |
2 |
37 |
1 |
1 |
34 |
39 |
10 |
22 |
71 |
| 21 |
2 |
26 |
1 |
1 |
43 |
38 |
3 |
19 |
64 |
| 22 |
2 |
46 |
1 |
2 |
48 |
50 |
14 |
28 |
83 |
| 23 |
1 |
43 |
1 |
1 |
47 |
48 |
5 |
25 |
68 |
| 24 |
2 |
37 |
1 |
2 |
40 |
46 |
2 |
20 |
85 |
| 27 |
1 |
51 |
1 |
1 |
40 |
41 |
6 |
14 |
56 |
| 30 |
2 |
41 |
1 |
2 |
41 |
40 |
3 |
31 |
84 |
| 31 |
1 |
47 |
1 |
2 |
47 |
48 |
17 |
15 |
82 |
| 32 |
2 |
45 |
1 |
2 |
45 |
50 |
8 |
35 |
90 |
| 43 |
1 |
28 |
1 |
1 |
32 |
38 |
3 |
21 |
70 |
| 45 |
2 |
44 |
1 |
1 |
41 |
40 |
2 |
18 |
79 |
| 47 |
2 |
57 |
1 |
2 |
39 |
47 |
13 |
22 |
90 |
| 51 |
2 |
39 |
1 |
1 |
41 |
42 |
7 |
19 |
64 |
| 53 |
1 |
27 |
1 |
1 |
47 |
43 |
2 |
18 |
63 |
| 60 |
2 |
49 |
1 |
2 |
41 |
42 |
2 |
15 |
84 |
| 4 |
1 |
31 |
2 |
1 |
32 |
38 |
1 |
16 |
52 |
| 5 |
1 |
33 |
2 |
1 |
35 |
36 |
7 |
20 |
70 |
| 9 |
1 |
25 |
2 |
1 |
41 |
38 |
2 |
17 |
58 |
| 11 |
1 |
25 |
2 |
1 |
42 |
36 |
3 |
20 |
62 |
| 14 |
1 |
60 |
2 |
2 |
43 |
39 |
14 |
27 |
72 |
| 16 |
2 |
39 |
2 |
2 |
31 |
34 |
1 |
20 |
78 |
| 18 |
2 |
33 |
2 |
2 |
37 |
37 |
3 |
20 |
64 |
| 19 |
2 |
29 |
2 |
1 |
39 |
47 |
5 |
13 |
59 |
| 25 |
1 |
33 |
2 |
1 |
44 |
39 |
2 |
14 |
53 |
| 34 |
1 |
41 |
2 |
2 |
32 |
34 |
2 |
16 |
62 |
| 35 |
1 |
34 |
2 |
1 |
36 |
36 |
7 |
21 |
75 |
| 39 |
1 |
27 |
2 |
1 |
38 |
48 |
2 |
18 |
58 |
| 41 |
1 |
30 |
2 |
1 |
42 |
38 |
3 |
21 |
62 |
| 44 |
1 |
58 |
2 |
2 |
34 |
43 |
18 |
27 |
72 |
| 46 |
2 |
46 |
2 |
2 |
43 |
45 |
12 |
35 |
78 |
| 48 |
2 |
32 |
2 |
2 |
36 |
36 |
3 |
21 |
64 |
| 49 |
2 |
27 |
2 |
1 |
39 |
40 |
5 |
13 |
59 |
| 52 |
2 |
44 |
2 |
2 |
28 |
49 |
3 |
28 |
83 |
| 54 |
2 |
46 |
2 |
2 |
46 |
47 |
10 |
21 |
85 |
| 55 |
1 |
33 |
2 |
1 |
38 |
46 |
1 |
14 |
53 |
| 3 |
1 |
31 |
3 |
1 |
28 |
30 |
4 |
16 |
60 |
| 7 |
2 |
35 |
3 |
1 |
44 |
45 |
13 |
27 |
75 |
| 8 |
1 |
28 |
3 |
2 |
40 |
40 |
4 |
23 |
60 |
| 10 |
1 |
28 |
3 |
1 |
31 |
32 |
3 |
15 |
75 |
| 12 |
1 |
29 |
3 |
1 |
38 |
38 |
6 |
16 |
58 |
| 20 |
2 |
34 |
3 |
2 |
40 |
42 |
7 |
26 |
73 |
| 26 |
2 |
26 |
3 |
2 |
33 |
32 |
3 |
21 |
63 |
| 28 |
2 |
45 |
3 |
2 |
33 |
33 |
10 |
28 |
80 |
| 29 |
2 |
44 |
3 |
1 |
37 |
43 |
15 |
30 |
69 |
| 33 |
1 |
31 |
3 |
1 |
31 |
33 |
3 |
16 |
60 |
| 36 |
1 |
29 |
3 |
2 |
43 |
44 |
2 |
22 |
59 |
| 37 |
2 |
35 |
3 |
2 |
46 |
45 |
11 |
28 |
80 |
| 38 |
1 |
39 |
3 |
2 |
33 |
34 |
3 |
23 |
60 |
| 40 |
1 |
30 |
3 |
2 |
30 |
32 |
2 |
15 |
55 |
| 42 |
1 |
28 |
3 |
2 |
33 |
36 |
6 |
17 |
58 |
| 50 |
2 |
43 |
3 |
2 |
44 |
37 |
7 |
26 |
73 |
| 56 |
2 |
27 |
3 |
2 |
38 |
39 |
3 |
21 |
63 |
| 57 |
1 |
43 |
3 |
1 |
39 |
40 |
6 |
14 |
73 |
| 58 |
2 |
44 |
3 |
2 |
31 |
33 |
5 |
28 |
80 |
| 59 |
2 |
54 |
3 |
1 |
37 |
38 |
14 |
22 |
70 |