Loading…

Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)

Full-field discrete measurements of the continuous spatiotemporal response of physical processes often generate large datasets. Such continuous spatiotemporal dynamic models are represented by partial differential equations (PDEs). In the past, attempts have been made to identify the PDE models from...

Full description

Saved in:
Bibliographic Details
Published in:Mechanical systems and signal processing 2023-04, Vol.189, p.110059, Article 110059
Main Authors: Bhowmick, Sutanu, Nagarajaiah, Satish, Kyrillidis, Anastasios
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13
cites cdi_FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13
container_end_page
container_issue
container_start_page 110059
container_title Mechanical systems and signal processing
container_volume 189
creator Bhowmick, Sutanu
Nagarajaiah, Satish
Kyrillidis, Anastasios
description Full-field discrete measurements of the continuous spatiotemporal response of physical processes often generate large datasets. Such continuous spatiotemporal dynamic models are represented by partial differential equations (PDEs). In the past, attempts have been made to identify the PDE models from the measured response by inferring its parameters via regression or deep learning-based techniques. But the previously presented regression-based methods fail to estimate the parameters of the higher-order PDE models in the presence of moderate noise. Likewise, the deep learning-based methods lack the much-needed property of repeatability and robustness in the identification of PDE models from the measured response. The proposed method of SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE) addresses such drawbacks by simultaneously fitting basis functions to the measured response and estimating the parameters of both ordinary and partial differential equations. The domain knowledge of the general multidimensional process is used as a constraint in the formulation of the optimization framework. The alternating direction method of multipliers (ADMM) algorithm is used to simultaneously optimize the loss function over the parameter space of the PDE model and coefficient space of the basis functions. The proposed method not only infers the parameters but also estimates a continuous function that approximates the solution to the PDE model. SNAPE not only demonstrates its applicability on various complex dynamic systems that encompass wide scientific domains including Schrödinger equation, chaotic duffing oscillator, and Navier–Stokes equation but also estimates an analytical approximation to the process response. The method systematically combines the knowledge of well-established scientific theories and the concepts of data science to infer the properties of the process from the observed data. •Parameter estimation of partial differential equation (PDE) models from noisy data.•Bi-convex optimization adopts the alternating direction method of multipliers (ADMM).•Simultaneously estimates an analytical approximation of the PDE solution.•Demonstrated on a wide variety of nonlinear PDE models.•Systematically combines domain knowledge and concepts of data science.
doi_str_mv 10.1016/j.ymssp.2022.110059
format article
fullrecord <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_ymssp_2022_110059</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S088832702201127X</els_id><sourcerecordid>S088832702201127X</sourcerecordid><originalsourceid>FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13</originalsourceid><addsrcrecordid>eNp9kMtOAzEMRSMEEqXwBWyyhMUUZ2aYJgsWVSkPqYJKwDoyiQOp2pkhySD6HfwwfcCWhWVZvte-OoydChgIENXFfLBaxtgOcsjzgRAAl2qP9QSoKhO5qPZZD6SUWZEP4ZAdxTgHAFVC1WPf15gw41hbnt6pCavsrfOWLF8QhtrXb7xxvMWQPC649c5RoHo70EeHyTd15F3c6J78slskfKCmi_wVo4_cdbXZSPiobUPz5Zdbw_bZDAMuKVHgk5j-FmdPD6PZ5PyYHThcRDr57X32cjN5Ht9l08fb-_FompkCipSp0ig5dEOFCqVQpcMSrDHopJLSIsK6hL2URgEUhVUVCSjVKxWGYAgoij4rdndNaGIM5HQb1lHCSgvQG656rrdc9Yar3nFdu652LlpH-_QUdDSeakPWBzJJ28b_6_8BfwqGEg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)</title><source>ScienceDirect Freedom Collection</source><creator>Bhowmick, Sutanu ; Nagarajaiah, Satish ; Kyrillidis, Anastasios</creator><creatorcontrib>Bhowmick, Sutanu ; Nagarajaiah, Satish ; Kyrillidis, Anastasios</creatorcontrib><description>Full-field discrete measurements of the continuous spatiotemporal response of physical processes often generate large datasets. Such continuous spatiotemporal dynamic models are represented by partial differential equations (PDEs). In the past, attempts have been made to identify the PDE models from the measured response by inferring its parameters via regression or deep learning-based techniques. But the previously presented regression-based methods fail to estimate the parameters of the higher-order PDE models in the presence of moderate noise. Likewise, the deep learning-based methods lack the much-needed property of repeatability and robustness in the identification of PDE models from the measured response. The proposed method of SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE) addresses such drawbacks by simultaneously fitting basis functions to the measured response and estimating the parameters of both ordinary and partial differential equations. The domain knowledge of the general multidimensional process is used as a constraint in the formulation of the optimization framework. The alternating direction method of multipliers (ADMM) algorithm is used to simultaneously optimize the loss function over the parameter space of the PDE model and coefficient space of the basis functions. The proposed method not only infers the parameters but also estimates a continuous function that approximates the solution to the PDE model. SNAPE not only demonstrates its applicability on various complex dynamic systems that encompass wide scientific domains including Schrödinger equation, chaotic duffing oscillator, and Navier–Stokes equation but also estimates an analytical approximation to the process response. The method systematically combines the knowledge of well-established scientific theories and the concepts of data science to infer the properties of the process from the observed data. •Parameter estimation of partial differential equation (PDE) models from noisy data.•Bi-convex optimization adopts the alternating direction method of multipliers (ADMM).•Simultaneously estimates an analytical approximation of the PDE solution.•Demonstrated on a wide variety of nonlinear PDE models.•Systematically combines domain knowledge and concepts of data science.</description><identifier>ISSN: 0888-3270</identifier><identifier>EISSN: 1096-1216</identifier><identifier>DOI: 10.1016/j.ymssp.2022.110059</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>ADMM optimization ; Basis function approximation ; Parameter estimation ; Partial differential equations ; Theory-guided learning</subject><ispartof>Mechanical systems and signal processing, 2023-04, Vol.189, p.110059, Article 110059</ispartof><rights>2022 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13</citedby><cites>FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13</cites><orcidid>0000-0003-0088-1656 ; 0000-0001-9350-4803</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,777,781,27905,27906</link.rule.ids></links><search><creatorcontrib>Bhowmick, Sutanu</creatorcontrib><creatorcontrib>Nagarajaiah, Satish</creatorcontrib><creatorcontrib>Kyrillidis, Anastasios</creatorcontrib><title>Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)</title><title>Mechanical systems and signal processing</title><description>Full-field discrete measurements of the continuous spatiotemporal response of physical processes often generate large datasets. Such continuous spatiotemporal dynamic models are represented by partial differential equations (PDEs). In the past, attempts have been made to identify the PDE models from the measured response by inferring its parameters via regression or deep learning-based techniques. But the previously presented regression-based methods fail to estimate the parameters of the higher-order PDE models in the presence of moderate noise. Likewise, the deep learning-based methods lack the much-needed property of repeatability and robustness in the identification of PDE models from the measured response. The proposed method of SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE) addresses such drawbacks by simultaneously fitting basis functions to the measured response and estimating the parameters of both ordinary and partial differential equations. The domain knowledge of the general multidimensional process is used as a constraint in the formulation of the optimization framework. The alternating direction method of multipliers (ADMM) algorithm is used to simultaneously optimize the loss function over the parameter space of the PDE model and coefficient space of the basis functions. The proposed method not only infers the parameters but also estimates a continuous function that approximates the solution to the PDE model. SNAPE not only demonstrates its applicability on various complex dynamic systems that encompass wide scientific domains including Schrödinger equation, chaotic duffing oscillator, and Navier–Stokes equation but also estimates an analytical approximation to the process response. The method systematically combines the knowledge of well-established scientific theories and the concepts of data science to infer the properties of the process from the observed data. •Parameter estimation of partial differential equation (PDE) models from noisy data.•Bi-convex optimization adopts the alternating direction method of multipliers (ADMM).•Simultaneously estimates an analytical approximation of the PDE solution.•Demonstrated on a wide variety of nonlinear PDE models.•Systematically combines domain knowledge and concepts of data science.</description><subject>ADMM optimization</subject><subject>Basis function approximation</subject><subject>Parameter estimation</subject><subject>Partial differential equations</subject><subject>Theory-guided learning</subject><issn>0888-3270</issn><issn>1096-1216</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNp9kMtOAzEMRSMEEqXwBWyyhMUUZ2aYJgsWVSkPqYJKwDoyiQOp2pkhySD6HfwwfcCWhWVZvte-OoydChgIENXFfLBaxtgOcsjzgRAAl2qP9QSoKhO5qPZZD6SUWZEP4ZAdxTgHAFVC1WPf15gw41hbnt6pCavsrfOWLF8QhtrXb7xxvMWQPC649c5RoHo70EeHyTd15F3c6J78slskfKCmi_wVo4_cdbXZSPiobUPz5Zdbw_bZDAMuKVHgk5j-FmdPD6PZ5PyYHThcRDr57X32cjN5Ht9l08fb-_FompkCipSp0ig5dEOFCqVQpcMSrDHopJLSIsK6hL2URgEUhVUVCSjVKxWGYAgoij4rdndNaGIM5HQb1lHCSgvQG656rrdc9Yar3nFdu652LlpH-_QUdDSeakPWBzJJ28b_6_8BfwqGEg</recordid><startdate>20230415</startdate><enddate>20230415</enddate><creator>Bhowmick, Sutanu</creator><creator>Nagarajaiah, Satish</creator><creator>Kyrillidis, Anastasios</creator><general>Elsevier Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0003-0088-1656</orcidid><orcidid>https://orcid.org/0000-0001-9350-4803</orcidid></search><sort><creationdate>20230415</creationdate><title>Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)</title><author>Bhowmick, Sutanu ; Nagarajaiah, Satish ; Kyrillidis, Anastasios</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>ADMM optimization</topic><topic>Basis function approximation</topic><topic>Parameter estimation</topic><topic>Partial differential equations</topic><topic>Theory-guided learning</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Bhowmick, Sutanu</creatorcontrib><creatorcontrib>Nagarajaiah, Satish</creatorcontrib><creatorcontrib>Kyrillidis, Anastasios</creatorcontrib><collection>CrossRef</collection><jtitle>Mechanical systems and signal processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Bhowmick, Sutanu</au><au>Nagarajaiah, Satish</au><au>Kyrillidis, Anastasios</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)</atitle><jtitle>Mechanical systems and signal processing</jtitle><date>2023-04-15</date><risdate>2023</risdate><volume>189</volume><spage>110059</spage><pages>110059-</pages><artnum>110059</artnum><issn>0888-3270</issn><eissn>1096-1216</eissn><abstract>Full-field discrete measurements of the continuous spatiotemporal response of physical processes often generate large datasets. Such continuous spatiotemporal dynamic models are represented by partial differential equations (PDEs). In the past, attempts have been made to identify the PDE models from the measured response by inferring its parameters via regression or deep learning-based techniques. But the previously presented regression-based methods fail to estimate the parameters of the higher-order PDE models in the presence of moderate noise. Likewise, the deep learning-based methods lack the much-needed property of repeatability and robustness in the identification of PDE models from the measured response. The proposed method of SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE) addresses such drawbacks by simultaneously fitting basis functions to the measured response and estimating the parameters of both ordinary and partial differential equations. The domain knowledge of the general multidimensional process is used as a constraint in the formulation of the optimization framework. The alternating direction method of multipliers (ADMM) algorithm is used to simultaneously optimize the loss function over the parameter space of the PDE model and coefficient space of the basis functions. The proposed method not only infers the parameters but also estimates a continuous function that approximates the solution to the PDE model. SNAPE not only demonstrates its applicability on various complex dynamic systems that encompass wide scientific domains including Schrödinger equation, chaotic duffing oscillator, and Navier–Stokes equation but also estimates an analytical approximation to the process response. The method systematically combines the knowledge of well-established scientific theories and the concepts of data science to infer the properties of the process from the observed data. •Parameter estimation of partial differential equation (PDE) models from noisy data.•Bi-convex optimization adopts the alternating direction method of multipliers (ADMM).•Simultaneously estimates an analytical approximation of the PDE solution.•Demonstrated on a wide variety of nonlinear PDE models.•Systematically combines domain knowledge and concepts of data science.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.ymssp.2022.110059</doi><orcidid>https://orcid.org/0000-0003-0088-1656</orcidid><orcidid>https://orcid.org/0000-0001-9350-4803</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0888-3270
ispartof Mechanical systems and signal processing, 2023-04, Vol.189, p.110059, Article 110059
issn 0888-3270
1096-1216
language eng
recordid cdi_crossref_primary_10_1016_j_ymssp_2022_110059
source ScienceDirect Freedom Collection
subjects ADMM optimization
Basis function approximation
Parameter estimation
Partial differential equations
Theory-guided learning
title Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T23%3A53%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Data-%20and%20theory-guided%20learning%20of%20partial%20differential%20equations%20using%20SimultaNeous%20basis%20function%20Approximation%20and%20Parameter%20Estimation%20(SNAPE)&rft.jtitle=Mechanical%20systems%20and%20signal%20processing&rft.au=Bhowmick,%20Sutanu&rft.date=2023-04-15&rft.volume=189&rft.spage=110059&rft.pages=110059-&rft.artnum=110059&rft.issn=0888-3270&rft.eissn=1096-1216&rft_id=info:doi/10.1016/j.ymssp.2022.110059&rft_dat=%3Celsevier_cross%3ES088832702201127X%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true