Sequential combination of weighted and nonparametric bagging for classification

• 成果类型: Article
• 署名作者: Soleymani, M.; Lee, S. M. S.
• 署名单位: University of Hong Kong
• 刊物名称: BIOMETRIKA
• ISSN/ISSBN: 0006-3444
• DOI: 10.1093/biomet/ast068
• 发表日期: 2014
• 页码: 491498
• 关键词: nearest-neighbor classifiers

摘要

We propose a simple sequential procedure for bagged classification, which modifies nonparametric bagging by randomizing class labels of resampled data points. The random labelling feature of the procedure also enables us to undertake unsupervised classification with the benefit of supervised learning. Theoretical properties are given for the nearest neighbour classifier in the case of supervised learning and a hard-thresholding indicator in the case of unsupervised learning, showing that sequential bagging accelerates convergence of the bagged predictor to the Bayes rule. Simulation results are provided in support of the proposed method.