RANDOM FORESTS AND MIXED EFFECTS RANDOM FORESTS FOR SMALL AREA ESTIMATION OF GENERAL PARAMETERS: A POVERTY MAPPING CASE STUDY IN MOZAMBIQUE

• 成果类型: Article
• 署名作者: Krennmair, Patrick; Wurz, Nora; Schmid, Timo; Tzavidis, Nikos
• 署名单位: Free University of Berlin; Otto Friedrich University Bamberg; University of Southampton; University of Southampton
• 刊物名称: ANNALS OF APPLIED STATISTICS
• ISSN/ISSBN: 1932-6157; 1941-7330
• DOI: 10.1214/25-AOAS2126
• 发表日期: 2026-03
• 页码: 809-832
• 关键词: Bootstrap bias correction; Machine Learning; mean squared error; mixed models; official statistics; Statistical learning; Robust Estimation; LEVEL MODELS; r package; prediction; bootstrap; BIAS; FRAMEWORK; errors; trees

摘要

Use of standard random forests may not guarantee reliable small area estimates unless a rich source of predictors explains the between-area heterogeneity. We propose mixed effects random forests with area random effects for small area estimation of general parameters. A new fitting algorithm with an embedded bootstrap-bias correction for the random forest residual variance is presented. Point estimators of small area parameters are constructed using a smearing estimator of the area-specific distribution function. Non-parametric block bootstrap is used for MSE estimation. The methodology is evaluated using household consumption data from Mozambique to derive district estimates of head count ratio and poverty gap. Comparisons to the empirical best predictor under a linear mixed model and to a synthetic estimator under the random forest are presented. Estimates are further contrasted to 2023 World Bank estimates and to design-unbiased direct estimates. The results show: (a) the advantages from including random effects in random forests, (b) the importance of data transformations for machine learning methods, (c) robustness properties of random forest-type methods, and (d) the importance of bias correcting the naive estimator of the random forest residual variance. Our conclusions demonstrate that a black-box approach to using machine learning methods should be avoided.