Statistical power and parameter stability when subjects are few and tests are many: Comment on Peterson, Smith, Martorana, and Owens (2003)

• 成果类型: Editorial Material
• 署名作者: Hollenbeck, JR; DeRue, DS; Mannor, M
• 署名单位: Michigan State University
• 刊物名称: JOURNAL OF APPLIED PSYCHOLOGY
• ISSN/ISSBN: 0021-9010
• DOI: 10.1037/0021-9010.91.1.1
• 发表日期: 2006
• 页码: 1-5
• 关键词: POWER; sample size; teams

摘要

This comment illustrates how small sample sizes, when combined with many statistical tests, can generate unstable parameter estimates and invalid inferences. Although statistical power for I test in a small-sample context is too low, the experimentwise power is often high when many tests are conducted, thus leading to Type I errors that will not replicate when retested. This comment's results show how radically the specific conclusions and inferences in R. S. Peterson, D. B. Smith. P. V. Martorana, and P. D. Owens's (2003) study changed with the inclusion or exclusion of I data point. When a more appropriate experimentwise statistical test was applied, the instability in the inferences was eliminated, but all the inferences become nonsignificant, thus changing the positive conclusions.