Discussion
XYZ is a new start up company that has about 150 employees. The company provides plumbing services to residential customers. The company has had a high turnover of plumbers, mostly due to the plumber's lack of knowledge and customer service skills. In order to address this, the company wanted to strengthen their selection process. So, they followed the procedure outlined below:
1. They selected 40 of their most successful plumbers (those who received outstanding customer feedback and had near zero calls from the customers about the work performed by these plumbers).
2. The company developed a 50-items multiple choice exam with four possible answers with only one answer being the correct one. Also, the company had another 50 questions consisting of True or False choices. Thus, the test had 100 questions. They called this plumbing knowledge test (PKT).
3. In order to strengthen the faith in the PKT, the company, after 6 months, chose the same 40 plumbers and this time they did something different. 20 of the 40 plumbers were given the exact same test they took six months ago (PKT). The remaining 20 plumbers were again given another 100 items test (50 multiple choice and 50 true false questions) but similar content that tested plumbing knowledge.
4. The company also developed a personality test that tapped into customer service skills, interpersonal skills, teamwork, persuasion skills, friendliness, etc. This personality test had about 50 statements (e.g., "Customers are always a priority for successful business" with answer format ranging from 1 = Strongly Agree, 2 = Agree, 3 = Neither Agree nor Disagree, 4 = Disagree, and 5 = Strongly Disagree.
5. Based on the scores on PKT and also on the personality test, candidates were short-listed and 3 managers interviewed the applicants separately. Each one ranked the candidate on a 5 point scale with 5 being most suitable and 1 being unsuitable.
Having completed this process, the company is now clueless as to what to do with the data. In other words they are wondering whether their system is reliable or not. Based on your knowledge of various reliability concepts, discuss:
a. For each of the three (PKT, Personality Test, and Interviews) which are the appropriate reliability technique to use? Explain why?
b. The company also learned of something called split-half reliability and KR20 formula. They want to see what it is. Which of the above three (PKT, Personality Test, and Interview Ratings) can use this technique to assess reliability? Why?
The response should include a reference list. Double-space, using Times New Roman 12 pnt font, one-inch margins, and APA style of writing and citations.