Everything That You Have Ever Been Told About Assessment Center Ratings Is Confounded

• 成果类型: Article
• 署名作者: Jackson, Duncan J. R.; Michaelides, George; Dewberry, Chris; Kim, Young-Jae
• 署名单位: University of London; Birkbeck University London; University of Johannesburg
• 刊物名称: JOURNAL OF APPLIED PSYCHOLOGY
• ISSN/ISSBN: 0021-9010
• DOI: 10.1037/apl0000102
• 发表日期: 2016
• 页码: 976-994
• 关键词: generalizability theory; Bayesian analysis; assessment centers

摘要

Despite a substantial research literature on the influence of dimensions and exercises in assessment centers (ACs), the relative impact of these 2 sources of variance continues to raise uncertainties because of confounding. With confounded effects, it is not possible to establish the degree to which any 1 effect, including those related to exercises and dimensions, influences AC ratings. In the current study (N = 698) we used Bayesian generalizability theory to unconfound all of the possible effects contributing to variance in AC ratings. Our results show that <= 1.11% of the variance in AC ratings was directly attributable to behavioral dimensions, suggesting that dimension-related effects have no practical impact on the reliability of ACs. Even when taking aggregation level into consideration, effects related to general performance and exercises accounted for almost all of the reliable variance in AC ratings. The implications of these findings for recent dimension-and exercise-based perspectives on ACs are discussed.