Calculate the following four reliability coefficients using the Pearson product-moment correlation formula, correlate the scores to...

Transcribed Image Text:

Calculate the following four reliability coefficients using the Pearson product-moment correlation formula, correlate the scores to determine the reliability coefficient (xx). Show your work. 3. Calculate the interrater reliability coefficient for the Initial interview rating by the HR recruiter by correlating it with the Interview rating of supervisor. a. What is the reliability coefficient b. Should this selection instrument be used for selection purposes? Why or why not? 4. Calculate the interrater reliability coefficient for the interview rating of the Supervisor by correlating it with the Senior Management. a. What is the reliability coefficient_ b. Should this selection instrument be used for selection purposes? Why or why not? 5. Calculate the interrater reliability coefficient for the interview rating by the Senior Management by correlating it with the interview rating of the HR recruiter. a. What is the reliability coefficient_ b. Should this selection instrument be used for selection purposes? Why or why not? TOC Appendix L. Reliability and Validity Data Number 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 23 24 25 26 27 28 29 30 Questions #3 #4 # 5 #6 #7 Applicant #7 (adj) Bobby Jill Jason Helen Jodi Tom Bruce Neil Ira Sydney Mal Bill John Courtney Abby Lisa Shn Christopher Justin Carl Beth Bethany Lenny Gerald Thomas Abigale Christina Table XX. Reliability Results n=30; df=28 Alex Elaine Mildred Augusta Reliability Coefficients Spearman- Brown Prophecy Formula = Intial Interview (HR Recruiter)* Table XX. SEM Results SEM (BAT 2) = 5 5 2 2 7 8 2 = 3 = 7 E 5 5 5 4 5 5 7 2 3 4 - 5 4 A 2 8 5 3 4 = 8 7 3 3 Results Interview Rating (Supervisor)* 2 0 3 5 3 9 8 3 7 5 7 8 9 2 2 2 6 3 9 4 = 7 6 6 7 7 E 5 8 6 8 9 6 5 5 5 7 8 Interview Rating (Senior MGT)* 5 8 6 4 10 7 = 4 7 4 9 6 5 5 7 5 6 4 8 2 = 2 = 3 5 3 5 3 5 6 7 7 4 5 9 5 3 1 Behavioral Assessment Test (BAT) Time 1** 22 62 72 58 92 Cutoff Value 77 44 52 91 84 31 42 37 82 73 48 42 28 88 54 71 73 91 93 52 83 58 44 58 67 Time 2** 38 61 59 Useful (yes/no) 64 94 85 45 61 97 87 38 41 44 89 68 62 52 36 96 45 58 82 94 98 68 95 68 56 52 61 BAT scores Time 2 Even 18 29 27 32 55 40 27 26 41 42 18 17 21 42 33 25 25 16 51 22 21 40 42 44 29 23 30 Hank Notes. * range is 1-10; range is 1-100; other selection instruments mentioned in the case were not included in this exercise. 33 55 55 39 27 29 31 Odd 20 32 32 32 39 45 18 57 35 56 45 20 24 23 47 35 37 27 20 45 23 37 42 52 54 35 40 40 29 Performance* 2 4 5 5 8 8 3 = 6 10 9 3 4 3 9 6 19 4 7 6 9 A 4 7 8 9 10 8 9 7 6 7 6 6. Calculate the test-retest reliability coefficient for the Behavior Assessment Test (BAT) by correlating time 1 and time 2. a. What is the reliability coefficient b. Should this selection instrument be used for selection purposes? Why or why not? 7. Calculate the Split-half reliability coefficient for the Behavior Assessment Test (BAT) time 2 only by correlating time 2 even scores and odd scores. However, the Split-half reliability coefficient tends to underestimate the reliability coefficient, because it is a smaller sample (i.e.. splitting the scores by even and odds, for example). Use the Spearman-Brown (SP) Prophecy formula to adjust for the smaller sample size. a. What is the reliability coefficient b. Calculate the adjusted reliability coefficient based on the Spearman-Brown (SP) Prophecy formula. 21 Ra= 1+I Where Isp = the adjusted reliability coefficient and rxx = the original reliability coefficient. c. Should this selection instrument be used for selection purposes? Why or why not? There was a large pool of qualified applicants. HR needs you to calculate the SEM for BAT at time 2 to help make several employment decisions. 8. Calculate the SEM for BAT (time 2 for adjusted reliability coefficient) using the following formula. SEM = sd 1-r. To calculate the SEM, multiple the standard deviation for the measure (i.e., BAT, time 2) by the square root of 1 - rp. where r is the reliability coefficient for the measure. SEM =_______. Show your work and use rap for your r. Note. It is important to be 95% confident in our predictions, so use 2 SEMs when calculating the confidence intervals. Provide the range of scores around the applicants score. Please use scores from BAT time 2 (#7 adjusted with the Spearman-Brown (SP) Prophecy formula). 9. What is the 95% confidence interval for Jason's (applicant #3) obtained score? 10. What is the 95% confidence interval for Beth's (applicant #19) obtained score? 11. Are these scores the same (there is overlap) or are they significantly different? 12. If you had to selected just one candidate using BAT, time 2, either Jason or Beth, which would it be and why? Note. To calculate the standard deviation use the formula (stdev.p) in Excel Calculate the following four reliability coefficients using the Pearson product-moment correlation formula, correlate the scores to determine the reliability coefficient (xx). Show your work. 3. Calculate the interrater reliability coefficient for the Initial interview rating by the HR recruiter by correlating it with the Interview rating of supervisor. a. What is the reliability coefficient b. Should this selection instrument be used for selection purposes? Why or why not? 4. Calculate the interrater reliability coefficient for the interview rating of the Supervisor by correlating it with the Senior Management. a. What is the reliability coefficient_ b. Should this selection instrument be used for selection purposes? Why or why not? 5. Calculate the interrater reliability coefficient for the interview rating by the Senior Management by correlating it with the interview rating of the HR recruiter. a. What is the reliability coefficient_ b. Should this selection instrument be used for selection purposes? Why or why not? TOC Appendix L. Reliability and Validity Data Number 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 23 24 25 26 27 28 29 30 Questions #3 #4 # 5 #6 #7 Applicant #7 (adj) Bobby Jill Jason Helen Jodi Tom Bruce Neil Ira Sydney Mal Bill John Courtney Abby Lisa Shn Christopher Justin Carl Beth Bethany Lenny Gerald Thomas Abigale Christina Table XX. Reliability Results n=30; df=28 Alex Elaine Mildred Augusta Reliability Coefficients Spearman- Brown Prophecy Formula = Intial Interview (HR Recruiter)* Table XX. SEM Results SEM (BAT 2) = 5 5 2 2 7 8 2 = 3 = 7 E 5 5 5 4 5 5 7 2 3 4 - 5 4 A 2 8 5 3 4 = 8 7 3 3 Results Interview Rating (Supervisor)* 2 0 3 5 3 9 8 3 7 5 7 8 9 2 2 2 6 3 9 4 = 7 6 6 7 7 E 5 8 6 8 9 6 5 5 5 7 8 Interview Rating (Senior MGT)* 5 8 6 4 10 7 = 4 7 4 9 6 5 5 7 5 6 4 8 2 = 2 = 3 5 3 5 3 5 6 7 7 4 5 9 5 3 1 Behavioral Assessment Test (BAT) Time 1** 22 62 72 58 92 Cutoff Value 77 44 52 91 84 31 42 37 82 73 48 42 28 88 54 71 73 91 93 52 83 58 44 58 67 Time 2** 38 61 59 Useful (yes/no) 64 94 85 45 61 97 87 38 41 44 89 68 62 52 36 96 45 58 82 94 98 68 95 68 56 52 61 BAT scores Time 2 Even 18 29 27 32 55 40 27 26 41 42 18 17 21 42 33 25 25 16 51 22 21 40 42 44 29 23 30 Hank Notes. * range is 1-10; range is 1-100; other selection instruments mentioned in the case were not included in this exercise. 33 55 55 39 27 29 31 Odd 20 32 32 32 39 45 18 57 35 56 45 20 24 23 47 35 37 27 20 45 23 37 42 52 54 35 40 40 29 Performance* 2 4 5 5 8 8 3 = 6 10 9 3 4 3 9 6 19 4 7 6 9 A 4 7 8 9 10 8 9 7 6 7 6 6. Calculate the test-retest reliability coefficient for the Behavior Assessment Test (BAT) by correlating time 1 and time 2. a. What is the reliability coefficient b. Should this selection instrument be used for selection purposes? Why or why not? 7. Calculate the Split-half reliability coefficient for the Behavior Assessment Test (BAT) time 2 only by correlating time 2 even scores and odd scores. However, the Split-half reliability coefficient tends to underestimate the reliability coefficient, because it is a smaller sample (i.e.. splitting the scores by even and odds, for example). Use the Spearman-Brown (SP) Prophecy formula to adjust for the smaller sample size. a. What is the reliability coefficient b. Calculate the adjusted reliability coefficient based on the Spearman-Brown (SP) Prophecy formula. 21 Ra= 1+I Where Isp = the adjusted reliability coefficient and rxx = the original reliability coefficient. c. Should this selection instrument be used for selection purposes? Why or why not? There was a large pool of qualified applicants. HR needs you to calculate the SEM for BAT at time 2 to help make several employment decisions. 8. Calculate the SEM for BAT (time 2 for adjusted reliability coefficient) using the following formula. SEM = sd 1-r. To calculate the SEM, multiple the standard deviation for the measure (i.e., BAT, time 2) by the square root of 1 - rp. where r is the reliability coefficient for the measure. SEM =_______. Show your work and use rap for your r. Note. It is important to be 95% confident in our predictions, so use 2 SEMs when calculating the confidence intervals. Provide the range of scores around the applicants score. Please use scores from BAT time 2 (#7 adjusted with the Spearman-Brown (SP) Prophecy formula). 9. What is the 95% confidence interval for Jason's (applicant #3) obtained score? 10. What is the 95% confidence interval for Beth's (applicant #19) obtained score? 11. Are these scores the same (there is overlap) or are they significantly different? 12. If you had to selected just one candidate using BAT, time 2, either Jason or Beth, which would it be and why? Note. To calculate the standard deviation use the formula (stdev.p) in Excel

Answer rating: 100% (QA)

The images show text instructions and data tables related to the calculation of various reliability ... View the full answer