Robust truncated hinge loss support vector machines

• 成果类型: Article
• 署名作者: Wu, Yichao; Liu, Yufeng
• 署名单位: Princeton University; University of North Carolina; University of North Carolina Chapel Hill
• 刊物名称: JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION
• ISSN/ISSBN: 0162-1459
• DOI: 10.1198/016214507000000617
• 发表日期: 2007
• 页码: 974-983
• 关键词: nonconcave penalized likelihood; variable selection; logistic-regression; CLASSIFICATION

摘要

The support vector machine (SVM) has been widely applied for classification problems in both machine learning and statistics. Despite its popularity, however, SVM has some drawbacks in certain situations. In particular, the SVM classifier can be very sensitive to outliers in the training sample. Moreover, the number of support vectors (SVs) can be very large in many applications. To circumvent these drawbacks, we propose the robust truncated hinge loss SVM (RSVM), which uses a truncated hinge loss. The RSVM is shown to be more robust to outliers and to deliver more accurate classifiers using a smaller set of SVs than the standard SVM. Our theoretical results show that the RSVM is Fisher-consistent, even when there is no dominating class, a scenario that is particularly challenging for multicategory classification. Similar results are obtained for a class of margin-based classifiers.