Training improve the quality of inferences made by raters in competency modeling? A quasi-experiment

• 成果类型: Article; Proceedings Paper
• 署名作者: Lievens, Filip; Sanchez, Juan I.
• 署名单位: Ghent University; State University System of Florida; Florida International University
• 刊物名称: JOURNAL OF APPLIED PSYCHOLOGY
• ISSN/ISSBN: 0021-9010
• DOI: 10.1037/0021-9010.92.3.812
• 发表日期: 2007
• 页码: 812-819
• 关键词: competency modeling; fraine-of-reference training; job analysis; rating

摘要

A quasi-experiment was conducted to investigate the effects of frame-of-reference training on the quality of competency modeling ratings made by consultants. Human resources consultants from a large consulting firm were randomly assigned to either a training or a control condition. The discriminant validity, interrater reliability, and accuracy of the competency ratings were significantly higher in the training group than in the control group. Further, the discriminant validity and interrater reliability of competency inferences were highest among an additional group of trained consultants who also had competency modeling experience. Together, these results suggest that procedural interventions such as rater training can significantly enhance the quality of competency modeling.