A Comparison of the Response-Pattern-Based Faking Detection Methods

• 成果类型: Article
• 署名作者: Nie, Weiwen; Hernandez, Ivan; Tay, Louis; Zhang, Bo; Cao, Mengyang
• 署名单位: Virginia Polytechnic Institute & State University; Purdue University System; Purdue University; University of Illinois System; University of Illinois Urbana-Champaign
• 刊物名称: JOURNAL OF APPLIED PSYCHOLOGY
• ISSN/ISSBN: 0021-9010
• DOI: 10.1037/apl0001261
• 发表日期: 2025
• 页码: 1015-1035
• 关键词: selection; Machine Learning; personality assessment; faking

摘要

The covariance index method, the idiosyncratic item response method, and the machine learning method are the three primary response-pattern-based (RPB) approaches to detect faking on personality tests. However, less is known about how their performance is affected by different practical factors (e.g., scale length, training sample size, proportion of faking participants) and when they perform optimally. In the present study, we systematically compared the three RPB faking detection methods across different conditions in three empirical-data-based resampling studies. Overall, we found that the machine learning method outperforms the other two RPB faking detection methods in most simulation conditions. It was also found that the faking probabilities produced by all three RPB faking detection methods had moderate to strong positive correlations with true personality scores, suggesting that these RPB faking detection methods are likely to misclassify honest respondents with truly high personality trait scores as fakers. Fortunately, we found that the benefit of removing suspicious fakers still outweighs the consequences of misclassification. Finally, we provided practical guidance to researchers and practitioners to optimally implement the machine learning method and offered step-by-step code.