WHEN JUSTICE IS BLIND TO ALGORITHMS : MULTILAYERED BLACKBOXING OF ALGORITHMIC DECISION-MAKING IN THE PUBLIC SECTOR

• 成果类型: Article
• 署名作者: Kronblad, Charlotta; Essen, Anna; Mahring, Magnus
• 署名单位: University of Gothenburg; Stockholm School of Economics
• 刊物名称: MIS QUARTERLY
• ISSN/ISSBN: 0276-7783
• DOI: 10.25300/MISQ/2024/18251
• 发表日期: 2024
• 页码: 1637-1662
• 关键词: SOCIAL CONSTRUCTION; big data; IGNORANCE; TECHNOLOGY; machine; KNOWLEDGE; fairness; science; datification; CHALLENGES

摘要

Both research and public discourse have recently drawn attention to the downsides of algorithmic decision- making (ADM), highlighting how it can produce biased and discriminatory outcomes and also pose threats to social justice. We address such threats that emanate from but also go beyond algorithms per se, extending to how public agencies and legal institutions respond or fail to respond to the consequences of ADM. Drawing on a case study of the use of an ADM system in public school administration, we explore the practices through which public institutions avoided engagement with the detrimental consequences ofADM, leading to injustice. We provide a conceptual model outlining how organizational ignoring practices can lead to social and institutional blackboxing of an ADM system, engendering both social and legal injustice. Our work paves the way for interdisciplinary research on the multilayered blackboxing of ADM. We also extend algorithmic injustice research to include a legal dimension and provide practical implications in the form of a legal framework for ADM in the public sector.