A Piecewise Linear Regression and Classification Algorithm With Application to Learning and Model Predictive Control of Hybrid Systems

• 成果类型: Article
• 署名作者: Bemporad, Alberto
• 署名单位: IMT School for Advanced Studies Lucca
• 刊物名称: IEEE TRANSACTIONS ON AUTOMATIC CONTROL
• ISSN/ISSBN: 0018-9286
• DOI: 10.1109/TAC.2022.3183036
• 发表日期: 2023
• 页码: 3194-3209
• 关键词: data models; predictive models; mathematical models; Numerical models; optimization; Prediction algorithms; Partitioning algorithms; hybrid systems; Mixed-Integer Programming; model predictive control (MPC); multicategory classification; multivariate regression; piecewise affine (PWA) systems; piecewise linear (PWL) functions

摘要

This article proposes an algorithm for solving multivariate regression and classification problems using piecewise linear predictors over a polyhedral partition of the feature space. The resulting algorithm that we call piecewise affine regression and classification (PARC) alternates between first, solving ridge regression problems for numeric targets, softmax regression problems for categorical targets, and either softmax regression or cluster centroid computation for piecewise linear separation, and second, assigning the training points to different clusters on the basis of a criterion that balances prediction accuracy and piecewise-linear separability. We prove that PARC is a block-coordinate descent algorithm that minimizes a suitably constructed objective function and that it converges in a finite number of steps. The algorithm is used to learn hybrid numerical/categorical dynamical models from data that contain real and discrete labeled values. The resulting model has a piecewise linear structure that is particularly useful to formulate model predictive control problems and solve them by mixed-integer programming.