The Effects of Response Instructions on Situational Judgment Test Performance and Validity in a High-Stakes Context

• 成果类型: Article
• 署名作者: Lievens, Filip; Sackett, Paul R.; Buyse, Tine
• 署名单位: Ghent University; University of Minnesota System; University of Minnesota Twin Cities
• 刊物名称: JOURNAL OF APPLIED PSYCHOLOGY
• ISSN/ISSBN: 0021-9010
• DOI: 10.1037/a0014628
• 发表日期: 2009
• 页码: 1095-1101
• 关键词: Situational Judgment Test; response instructions; high-stakes testing

摘要

This study fills a key gap in research on response instructions in situational judgment tests (SJTs). The authors examined whether the assumptions behind the differential effects of knowledge and behavioral tendency SJT response instructions hold in a large-scale high-stakes selection context (i.e., admission to medical college). Candidates (N = 2,184) were randomly assigned to a knowledge or behavioral tendency response instruction SJT, while SJT content was kept constant. Contrary to prior research in low-stakes settings, no meaningfully important differences were found between mean scores for the response instruction sets. Consistent with prior research, the SJT with knowledge instructions correlated more highly with cognitive ability than did the SJT with behavioral tendency instructions. Finally, no difference was found between the criterion-related validity of the SJTs under the two response instruction sets.