Assessing measurement equivalence across rating sources: A multitrait-multirater approach

• 成果类型: Article
• 署名作者: Woehr, DJ; Sheehan, MK; Bennett, W Jr
• 署名单位: University of Tennessee System; University of Tennessee Knoxville; Texas A&M University System; Texas A&M University College Station; United States Department of Defense; United States Air Force
• 刊物名称: JOURNAL OF APPLIED PSYCHOLOGY
• ISSN/ISSBN: 0021-9010
• DOI: 10.1037/0021-9010.90.3.592
• 发表日期: 2005
• 页码: 592-600
• 关键词: multisource performance ratings; measurement equivalence; performance appraisal; self-other agreement

摘要

Research examining the structure of multisource performance ratings has demonstrated that ratings are a direct function of both who is doing the rating (rating source) as well as what is being rated (performance dimension). A separate line of research has focused on the extent to which performance ratings are equivalent across sources. To date no research has examined the measurement equivalence of multisource ratings within the context of both dimension and rating source direct effects on ratings. We examine the impact of both performance dimension and rating source as well as the degree of measurement equivalence across sources. Results indicate that (a) the impact of the underlying performance dimension is the same across rating sources, (b) the impact of rating source is substantial and only slightly smaller than the impact of the underlying performance dimension, and (c) the impact of rating source differs substantially depending on the source.