Theoretical and Interpretation Challenges to Using the Author Affiliation Index Method to Rank Journals

• 成果类型: Article
• 署名作者: Agrawal, Vijay K.; Agrawal, Vipin; Rungtusanatham, M.
• 署名单位: University of Nebraska System; University Nebraska Kearney; California State University System; California State University Fullerton; University of Minnesota System; University of Minnesota Twin Cities
• 刊物名称: PRODUCTION AND OPERATIONS MANAGEMENT
• ISSN/ISSBN: 1059-1478
• DOI: 10.1111/J.1937-5956.2010.01212.X
• 发表日期: 2011
• 页码: 280-300
• 关键词: multiple comparison procedures; operations management; constituencies; MISUSE

摘要

We formally review the Author Affiliation Index (AAI) method as originally conceived by David Harless and Robert J. Reilly from the Economics Department at the Virginia Commonwealth University School of Business and as subsequently developed and interpreted by Gorman and Kanet in their 2005 article. Through this formal review, we first highlight and discuss two important informational inputs that can impact the stability of the AAI scores for journals in any given set of to-be-evaluated journals. We then identify and challenge interpretations related to these scores (one theoretical, one statistical) offered by Gorman and Kanet that result in misleading conclusions about journal quality and that may potentially motivate inappropriate editorial behavior. For important professional decisions of hiring, performance evaluation, promotion, and tenure, we conclude by cautioning against sole reliance on the AAI method for ranking journals and against exclusive interpretation of the score computed via the AAI method as an indicator of journal quality.