Video-based versus written situational judgment tests: A comparison in terms of predictive validity

• 成果类型: Article; Proceedings Paper
• 署名作者: Lievens, Filip; Sackett, Paul R.
• 署名单位: Ghent University; University of Minnesota System; University of Minnesota Twin Cities
• 刊物名称: JOURNAL OF APPLIED PSYCHOLOGY
• ISSN/ISSBN: 0021-9010
• DOI: 10.1037/0021-9010.91.5.1181
• 发表日期: 2006
• 页码: 1181-1188
• 关键词: Situational Judgment Test; video; predictive validity

摘要

In this study, the authors examined whether video-based situational judgment tests (SJTs) have higher predictive validity than written SJTs (keeping verbal content constant). The samples consisted of 1, 159 students who completed a video-based version of an SIT and 1,750 students who completed the same SIT in a written format. The study was conducted in a high stakes testing context. The video-based version of an interpersonally oriented SJT had a lower correlation with cognitive ability than did the written version. It also had higher predictive and incremental validity for predicting interpersonally oriented criteria than did the written version. In this high stakes context, applicants also reacted relatively favorably to the SJTs, although there was no significant difference in face validity between the formats. These findings suggest that SIT format changes be made with caution and that validation evidence is needed when changes are proposed.