TY - JOUR
T1 - Progress in psychometrics
T2 - Can industrial and organizational psychology catch up?
AU - Murphy, Kevin R.
AU - De Shon, Richard
PY - 2000
Y1 - 2000
N2 - Murphy and DeShon (2000) show that interrater correlations do not provide reasonable estimates of the reliability of job performance ratings, and suggest that better estimates can be obtained by applying the methods of generalizability theory. Schmidt, Viswesvaran, and Ones (2000) criticize our suggestions as radical, and argue that: (a) the reliability of ratings should be evaluated using the parallel test model rather than the more general and more realistic generalizability model, (b) reliability and validity are distinct concepts that should not be confused, and (c) measurement models have little to do with substantive models of the processes that generate scores on a test or measure. All three of these ideas were once part of the psychometric mainstream, but progress in psychometrics over the last 3 decades has moved the field well beyond these assumptions and approaches. Modern psychometric theory calls for close linkages between measurement models and substantive models of the phenomena being measured.
AB - Murphy and DeShon (2000) show that interrater correlations do not provide reasonable estimates of the reliability of job performance ratings, and suggest that better estimates can be obtained by applying the methods of generalizability theory. Schmidt, Viswesvaran, and Ones (2000) criticize our suggestions as radical, and argue that: (a) the reliability of ratings should be evaluated using the parallel test model rather than the more general and more realistic generalizability model, (b) reliability and validity are distinct concepts that should not be confused, and (c) measurement models have little to do with substantive models of the processes that generate scores on a test or measure. All three of these ideas were once part of the psychometric mainstream, but progress in psychometrics over the last 3 decades has moved the field well beyond these assumptions and approaches. Modern psychometric theory calls for close linkages between measurement models and substantive models of the phenomena being measured.
UR - http://www.scopus.com/inward/record.url?scp=0347110839&partnerID=8YFLogxK
U2 - 10.1111/j.1744-6570.2000.tb02423.x
DO - 10.1111/j.1744-6570.2000.tb02423.x
M3 - Article
AN - SCOPUS:0347110839
SN - 0031-5826
VL - 53
SP - 913
EP - 924
JO - Personnel Psychology
JF - Personnel Psychology
IS - 4
ER -