Assignment -
Below is a sample item analysis that shows the summary table of statistics for all items (questions) for a pilot assessment of a memory test. The memory test presents a short video depicting a law enforcement scenario and requires candidates to recall relevant details. The test is comprised of 10 multiple choice questions with four options (A-D). For the sample of 10 items, the correct answer is "A". Review the item difficulty (P), discrimination [R(IT)], and the distractors (options B-D).
Prepare a response to address:
1. What is the difficulty level for each item (i.e., easy, medium, hard)? What is the overall difficulty level of the test?
2. Which item(s) could you remove altogether from the exam? Why?
3. Which distractor(s) would you revise? Why?
4. Which items are working well? Why?
5. What next steps in test development would you recommend?
|
Summary Table of Test Item Statistics: Memory Test
N TOTAL = 932
MEAN TOTAL = 69.4
STDEV TOTAL = 10.2
ALPHA = .84
|
|
Test Item
|
P
|
R(IT)
|
NC
|
MC
|
MI
|
OMIT
|
Item Response Option
|
|
A
|
B
|
C
|
D
|
|
0.72
|
0.34
|
667
|
71.56
|
67.66
|
1
|
667
|
187
|
37
|
40
|
|
0.90
|
0.21
|
840
|
70.11
|
69.02
|
1
|
840
|
1
|
81
|
9
|
|
0.60
|
0.39
|
561
|
72.66
|
65.47
|
0
|
561
|
233
|
46
|
92
|
|
0.99
|
-0.06
|
923
|
69.34
|
69.90
|
0
|
923
|
4
|
5
|
0
|
|
0.94
|
0.14
|
876
|
69.76
|
68.23
|
0
|
876
|
0
|
22
|
34
|
|
0.77
|
-0.01
|
716
|
69.34
|
69.57
|
0
|
716
|
16
|
30
|
135
|
|
0.47
|
0.31
|
432
|
72.76
|
66.16
|
3
|
432
|
207
|
68
|
165
|
|
0.12
|
0.08
|
114
|
71.61
|
68.39
|
8
|
114
|
318
|
334
|
158
|
|
0.08
|
0.04
|
75
|
70.78
|
69.03
|
0
|
75
|
604
|
184
|
73
|
|
0.35
|
0.42
|
330
|
75.24
|
63.54
|
0
|
339
|
108
|
124
|
183
|
Length: 5-7 pages.