nPINNs: Nonlocal physics-informed neural networks for a parametrized nonlocal universal Laplacian operator. Algorithms and applications

• Published in: Journal of computational physics 2020-12, Vol.422 (C), p.109760, Article 109760
• Main Authors: Pang, G., D'Elia, M., Parks, M., Karniadakis, G.E.
• Format: Article
• Language: English
• Subjects: Algorithms; Boundary conditions; Computational fluid dynamics; Computational physics; Convergence; Convexity; Couette flow; Deep learning; Differential equations; Fluid flow; Fractional Laplacian; Integral equations; Interaction parameters; Inverse problems; Neural networks; Nonlocal models; Operators (mathematics); Optimization; Parameter estimation; Physics-informed neural networks; Reynolds number; Turbulence modeling; Turbulence models; Turbulent flow; Unstructured data
• ISSN: 0021-9991; 1090-2716
• DOI: 10.1016/j.jcp.2020.109760

•We introduce a new universal nonlocal Laplace operator.•The universal operator includes classical and fractional Laplacians as limits.•We propose nonlocal physics-informed neural networks for parameter identification.•We illustrate consistency and accuracy, and discover operator-mimicking phenomena.•We apply our algorithm to a fractional wall-bounded turbulence model. Physics-informed neural networks (PINNs) are effective in solving inverse problems based on differential and integro-differential equations with sparse, noisy, unstructured, and multi-fidelity data. PINNs incorporate all available information, including governing equations (reflecting physical laws), initial-boundary conditions, and observations of quantities of interest, into a loss function to be minimized, thus recasting the original problem into an optimization problem. In this paper, we extend PINNs to parameter and function inference for integral equations such as nonlocal Poisson and nonlocal turbulence models, and we refer to them as nonlocal PINNs (nPINNs). The contribution of the paper is three-fold. First, we propose a unified nonlocal Laplace operator, which converges to the classical Laplacian as one of the operator parameters, the nonlocal interaction radius δ goes to zero, and to the fractional Laplacian as δ goes to infinity. This universal operator forms a super-set of classical Laplacian and fractional Laplacian operators and, thus, has the potential to fit a broad spectrum of data sets. We provide theoretical convergence rates with respect to δ and verify them via numerical experiments. Second, we use nPINNs to estimate the two parameters, δ and α, characterizing the kernel of the unified operator. The strong non-convexity of the loss function yielding multiple (good) local minima reveals the occurrence of the operator mimicking phenomenon, that is, different pairs of estimated parameters could produce multiple solutions of comparable accuracy. Third, we propose another nonlocal operator with spatially variable order α(y), which is more suitable for modeling wall-bounded turbulence, e.g. turbulent Couette flow. Our results show that nPINNs can jointly infer this function as well as δ. More importantly, these parameters exhibit a universal behavior with respect to the Reynolds number, a finding that contributes to our understanding of nonlocal interactions in wall-bounded turbulence.