Regularized nonlinear regression for simultaneously selecting and estimating key model parameters: Application to head-neck position tracking

• Published in: Engineering applications of artificial intelligence 2022-08, Vol.113, p.104974, Article 104974
• Main Authors: Yoon, Kyubaek, You, Hojun, Wu, Wei-Ying, Lim, Chae Young, Choi, Jongeun, Boss, Connor, Ramadan, Ahmed, Popovich, John M., Cholewicki, Jacek, Reeves, N. Peter, Radcliffe, Clark J.
• Format: Article
• Language: English
• Subjects: [formula omitted]-regularization; Head-neck model; Identifiability; Nonlinear regression; System identification
• ISSN: 0952-1976; 1873-6769
• DOI: 10.1016/j.engappai.2022.104974

In system identification, estimating parameters of a biomechanical model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model parameters while fixing the remaining parameters to a set of typical values. The problem is formulated as a nonlinear least-squares estimator with L1-regularization on the deviation of parameters from a set of typical values. In addition, a modified optimization approach is introduced to find the solution to the formulated problem. As a result, we provided consistency and oracle properties of the proposed estimator as a theoretical foundation. To show the effectiveness of the proposed method, we conducted simulation and experimental studies. In the simulation study, the proposed Lasso performed significantly better than the ordinary L1-regularization methods in terms of the bias and variance of the parameter estimates. The experimental study presented an application identifying a biomechanical parametric model of a head position tracking task for ten human subjects from limited data. Compared with the variance of the parameter estimates from nonlinear ordinary least-squares regression, that of parameter estimates from the proposed Lasso decreased by 96% using the simulated data. Using the real-world data, the variance of estimated parameters decreased by 71%. In addition, the proposed method kept variance accounted for (VAF) at 83% and was 54 times faster than the ordinary Lasso using a standard simplex-based optimization algorithm.