Variable Selection According to Goodness of Fit in Nonparametric Nonlinear System Identification

• 成果类型: Article
• 署名作者: Cheng, Changming; Bai, Er-Wei
• 署名单位: Shanghai Jiao Tong University; University of Iowa
• 刊物名称: IEEE TRANSACTIONS ON AUTOMATIC CONTROL
• ISSN/ISSBN: 0018-9286
• DOI: 10.1109/TAC.2020.3015744
• 发表日期: 2021
• 页码: 3184-3196
• 关键词: Input variables; Nonlinear systems; kernel; Hilbert space; Machine Learning; sensitivity; genomics; Nonlinear identification; nonparametric systems; Reproducing kernel Hilbert space (RKHS); variable selection

摘要

To achieve a parsimonious model, it is necessary to rank the importance of input variables according to some measures. The problem is nontrivial in the setting of nonlinear and nonparametric system identification. Difficulties lie in the lack of structural information of the unknown system, unknown underlying probabilistic distributions, and unknown nonlinear correlations of variables. In this article, we present a way to rank variables according to goodness of fit (GoF). Asymptotic results are established, and numerical algorithms are proposed. The problem is cast in a reproducing kernel Hilbert space (RKHS) that allows us to deal with nonparametric nature of the unknown system, to avoid making strong conditions on the unknown distributions, to link GoFs to computable conditional covariance operators on RKHS, and to develop computationally friendly numerical algorithms. Numerical simulations support the theoretical developments.