MIXTURE CONDITIONAL REGRESSION WITH ULTRAHIGH

• 成果类型: Article
• 署名作者: Shi, Jiaxin; Wang, Fang; Gao, Yuan; Song, Xiaojun; Wang, Hansheng
• 署名单位: Peking University; Shandong University; Peking University; Peking University
• 刊物名称: ANNALS OF APPLIED STATISTICS
• ISSN/ISSBN: 1932-6157
• DOI: 10.1214/24-AOAS1893
• 发表日期: 2024
• 页码: 2532-2550
• 关键词: maximum-likelihood; em algorithm; MODEL; selection

摘要

Testing judicial impartiality is a problem of fundamental importance in empirical legal studies for which standard regression methods have been popularly used to estimate the extralegal factor effects. However, those methods cannot handle control variables with ultrahigh dimensionality, such as those found in judgment documents recorded in text format. To solve this problem, we develop a novel mixture conditional regression (MCR) approach, assuming that the whole sample can be classified into a number of latent classes. Within each latent class, a standard linear regression model can be used to model the relationship between the response and a key feature vector, which is assumed to be of a fixed dimension. Meanwhile, ultrahigh dimensional control variables are then used to determine the latent class membership, where a na & iuml;ve Bayes type model is used to describe the relationship. Hence, the dimension of control variables is allowed to be arbitrarily high. A novel expectation-maximization algorithm is developed for model estimation. Therefore, we are able to estimate the key parameters of interest as efficiently as if the true class membership were known in advance. Simulation studies are presented to demonstrate the proposed MCR method. A real dataset of Chinese burglary offenses is analyzed for illustration purposes.