Numerical Solution of Stiff ODEs with Physics-Informed RPNNs

• Published in: arXiv.org 2021-11
• Main Authors: Galaris, Evangelos, Fabiani, Gianluca, Calabrò, Francesco, Daniela di Serafino, Siettos, Constantinos
• Format: Article
• Language: English
• Subjects: Artificial neural networks; Differential equations; Gauss-Newton method; Machine learning; Neural networks; Newton methods; Numerical differentiation; Ordinary differential equations; Radial basis function; Random variables; Runge-Kutta method; Stiffness; Time integration
• ISSN: 2331-8422

We propose a numerical method based on physics-informed Random Projection Neural Networks for the solution of Initial Value Problems (IVPs) of Ordinary Differential Equations (ODEs) with a focus on stiff problems. We address an Extreme Learning Machine with a single hidden layer with radial basis functions having as widths uniformly distributed random variables, while the values of the weights between the input and the hidden layer are set equal to one. The numerical solution of the IVPs is obtained by constructing a system of nonlinear algebraic equations, which is solved with respect to the output weights by the Gauss-Newton method, using a simple adaptive scheme for adjusting the time interval of integration. To assess its performance, we apply the proposed method for the solution of four benchmark stiff IVPs, namely the Prothero-Robinson, van der Pol, ROBER and HIRES problems. Our method is compared with an adaptive Runge-Kutta method based on the Dormand-Prince pair, and a variable-step variable-order multistep solver based on numerical differentiation formulas, as implemented in the \texttt{ode45} and \texttt{ode15s} MATLAB functions, respectively. We show that the proposed scheme yields good approximation accuracy, thus outperforming \texttt{ode45} and \texttt{ode15s}, especially in the cases where steep gradients arise. Furthermore, the computational times of our approach are comparable with those of the two MATLAB solvers for practical purposes.