Loading…
Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)
Full-field discrete measurements of the continuous spatiotemporal response of physical processes often generate large datasets. Such continuous spatiotemporal dynamic models are represented by partial differential equations (PDEs). In the past, attempts have been made to identify the PDE models from...
Saved in:
Published in: | Mechanical systems and signal processing 2023-04, Vol.189, p.110059, Article 110059 |
---|---|
Main Authors: | , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13 |
---|---|
cites | cdi_FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13 |
container_end_page | |
container_issue | |
container_start_page | 110059 |
container_title | Mechanical systems and signal processing |
container_volume | 189 |
creator | Bhowmick, Sutanu Nagarajaiah, Satish Kyrillidis, Anastasios |
description | Full-field discrete measurements of the continuous spatiotemporal response of physical processes often generate large datasets. Such continuous spatiotemporal dynamic models are represented by partial differential equations (PDEs). In the past, attempts have been made to identify the PDE models from the measured response by inferring its parameters via regression or deep learning-based techniques. But the previously presented regression-based methods fail to estimate the parameters of the higher-order PDE models in the presence of moderate noise. Likewise, the deep learning-based methods lack the much-needed property of repeatability and robustness in the identification of PDE models from the measured response. The proposed method of SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE) addresses such drawbacks by simultaneously fitting basis functions to the measured response and estimating the parameters of both ordinary and partial differential equations. The domain knowledge of the general multidimensional process is used as a constraint in the formulation of the optimization framework. The alternating direction method of multipliers (ADMM) algorithm is used to simultaneously optimize the loss function over the parameter space of the PDE model and coefficient space of the basis functions. The proposed method not only infers the parameters but also estimates a continuous function that approximates the solution to the PDE model. SNAPE not only demonstrates its applicability on various complex dynamic systems that encompass wide scientific domains including Schrödinger equation, chaotic duffing oscillator, and Navier–Stokes equation but also estimates an analytical approximation to the process response. The method systematically combines the knowledge of well-established scientific theories and the concepts of data science to infer the properties of the process from the observed data.
•Parameter estimation of partial differential equation (PDE) models from noisy data.•Bi-convex optimization adopts the alternating direction method of multipliers (ADMM).•Simultaneously estimates an analytical approximation of the PDE solution.•Demonstrated on a wide variety of nonlinear PDE models.•Systematically combines domain knowledge and concepts of data science. |
doi_str_mv | 10.1016/j.ymssp.2022.110059 |
format | article |
fullrecord | <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_ymssp_2022_110059</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S088832702201127X</els_id><sourcerecordid>S088832702201127X</sourcerecordid><originalsourceid>FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13</originalsourceid><addsrcrecordid>eNp9kMtOAzEMRSMEEqXwBWyyhMUUZ2aYJgsWVSkPqYJKwDoyiQOp2pkhySD6HfwwfcCWhWVZvte-OoydChgIENXFfLBaxtgOcsjzgRAAl2qP9QSoKhO5qPZZD6SUWZEP4ZAdxTgHAFVC1WPf15gw41hbnt6pCavsrfOWLF8QhtrXb7xxvMWQPC649c5RoHo70EeHyTd15F3c6J78slskfKCmi_wVo4_cdbXZSPiobUPz5Zdbw_bZDAMuKVHgk5j-FmdPD6PZ5PyYHThcRDr57X32cjN5Ht9l08fb-_FompkCipSp0ig5dEOFCqVQpcMSrDHopJLSIsK6hL2URgEUhVUVCSjVKxWGYAgoij4rdndNaGIM5HQb1lHCSgvQG656rrdc9Yar3nFdu652LlpH-_QUdDSeakPWBzJJ28b_6_8BfwqGEg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)</title><source>ScienceDirect Freedom Collection</source><creator>Bhowmick, Sutanu ; Nagarajaiah, Satish ; Kyrillidis, Anastasios</creator><creatorcontrib>Bhowmick, Sutanu ; Nagarajaiah, Satish ; Kyrillidis, Anastasios</creatorcontrib><description>Full-field discrete measurements of the continuous spatiotemporal response of physical processes often generate large datasets. Such continuous spatiotemporal dynamic models are represented by partial differential equations (PDEs). In the past, attempts have been made to identify the PDE models from the measured response by inferring its parameters via regression or deep learning-based techniques. But the previously presented regression-based methods fail to estimate the parameters of the higher-order PDE models in the presence of moderate noise. Likewise, the deep learning-based methods lack the much-needed property of repeatability and robustness in the identification of PDE models from the measured response. The proposed method of SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE) addresses such drawbacks by simultaneously fitting basis functions to the measured response and estimating the parameters of both ordinary and partial differential equations. The domain knowledge of the general multidimensional process is used as a constraint in the formulation of the optimization framework. The alternating direction method of multipliers (ADMM) algorithm is used to simultaneously optimize the loss function over the parameter space of the PDE model and coefficient space of the basis functions. The proposed method not only infers the parameters but also estimates a continuous function that approximates the solution to the PDE model. SNAPE not only demonstrates its applicability on various complex dynamic systems that encompass wide scientific domains including Schrödinger equation, chaotic duffing oscillator, and Navier–Stokes equation but also estimates an analytical approximation to the process response. The method systematically combines the knowledge of well-established scientific theories and the concepts of data science to infer the properties of the process from the observed data.
•Parameter estimation of partial differential equation (PDE) models from noisy data.•Bi-convex optimization adopts the alternating direction method of multipliers (ADMM).•Simultaneously estimates an analytical approximation of the PDE solution.•Demonstrated on a wide variety of nonlinear PDE models.•Systematically combines domain knowledge and concepts of data science.</description><identifier>ISSN: 0888-3270</identifier><identifier>EISSN: 1096-1216</identifier><identifier>DOI: 10.1016/j.ymssp.2022.110059</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>ADMM optimization ; Basis function approximation ; Parameter estimation ; Partial differential equations ; Theory-guided learning</subject><ispartof>Mechanical systems and signal processing, 2023-04, Vol.189, p.110059, Article 110059</ispartof><rights>2022 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13</citedby><cites>FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13</cites><orcidid>0000-0003-0088-1656 ; 0000-0001-9350-4803</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,777,781,27905,27906</link.rule.ids></links><search><creatorcontrib>Bhowmick, Sutanu</creatorcontrib><creatorcontrib>Nagarajaiah, Satish</creatorcontrib><creatorcontrib>Kyrillidis, Anastasios</creatorcontrib><title>Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)</title><title>Mechanical systems and signal processing</title><description>Full-field discrete measurements of the continuous spatiotemporal response of physical processes often generate large datasets. Such continuous spatiotemporal dynamic models are represented by partial differential equations (PDEs). In the past, attempts have been made to identify the PDE models from the measured response by inferring its parameters via regression or deep learning-based techniques. But the previously presented regression-based methods fail to estimate the parameters of the higher-order PDE models in the presence of moderate noise. Likewise, the deep learning-based methods lack the much-needed property of repeatability and robustness in the identification of PDE models from the measured response. The proposed method of SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE) addresses such drawbacks by simultaneously fitting basis functions to the measured response and estimating the parameters of both ordinary and partial differential equations. The domain knowledge of the general multidimensional process is used as a constraint in the formulation of the optimization framework. The alternating direction method of multipliers (ADMM) algorithm is used to simultaneously optimize the loss function over the parameter space of the PDE model and coefficient space of the basis functions. The proposed method not only infers the parameters but also estimates a continuous function that approximates the solution to the PDE model. SNAPE not only demonstrates its applicability on various complex dynamic systems that encompass wide scientific domains including Schrödinger equation, chaotic duffing oscillator, and Navier–Stokes equation but also estimates an analytical approximation to the process response. The method systematically combines the knowledge of well-established scientific theories and the concepts of data science to infer the properties of the process from the observed data.
•Parameter estimation of partial differential equation (PDE) models from noisy data.•Bi-convex optimization adopts the alternating direction method of multipliers (ADMM).•Simultaneously estimates an analytical approximation of the PDE solution.•Demonstrated on a wide variety of nonlinear PDE models.•Systematically combines domain knowledge and concepts of data science.</description><subject>ADMM optimization</subject><subject>Basis function approximation</subject><subject>Parameter estimation</subject><subject>Partial differential equations</subject><subject>Theory-guided learning</subject><issn>0888-3270</issn><issn>1096-1216</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNp9kMtOAzEMRSMEEqXwBWyyhMUUZ2aYJgsWVSkPqYJKwDoyiQOp2pkhySD6HfwwfcCWhWVZvte-OoydChgIENXFfLBaxtgOcsjzgRAAl2qP9QSoKhO5qPZZD6SUWZEP4ZAdxTgHAFVC1WPf15gw41hbnt6pCavsrfOWLF8QhtrXb7xxvMWQPC649c5RoHo70EeHyTd15F3c6J78slskfKCmi_wVo4_cdbXZSPiobUPz5Zdbw_bZDAMuKVHgk5j-FmdPD6PZ5PyYHThcRDr57X32cjN5Ht9l08fb-_FompkCipSp0ig5dEOFCqVQpcMSrDHopJLSIsK6hL2URgEUhVUVCSjVKxWGYAgoij4rdndNaGIM5HQb1lHCSgvQG656rrdc9Yar3nFdu652LlpH-_QUdDSeakPWBzJJ28b_6_8BfwqGEg</recordid><startdate>20230415</startdate><enddate>20230415</enddate><creator>Bhowmick, Sutanu</creator><creator>Nagarajaiah, Satish</creator><creator>Kyrillidis, Anastasios</creator><general>Elsevier Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0003-0088-1656</orcidid><orcidid>https://orcid.org/0000-0001-9350-4803</orcidid></search><sort><creationdate>20230415</creationdate><title>Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)</title><author>Bhowmick, Sutanu ; Nagarajaiah, Satish ; Kyrillidis, Anastasios</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>ADMM optimization</topic><topic>Basis function approximation</topic><topic>Parameter estimation</topic><topic>Partial differential equations</topic><topic>Theory-guided learning</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Bhowmick, Sutanu</creatorcontrib><creatorcontrib>Nagarajaiah, Satish</creatorcontrib><creatorcontrib>Kyrillidis, Anastasios</creatorcontrib><collection>CrossRef</collection><jtitle>Mechanical systems and signal processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Bhowmick, Sutanu</au><au>Nagarajaiah, Satish</au><au>Kyrillidis, Anastasios</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE)</atitle><jtitle>Mechanical systems and signal processing</jtitle><date>2023-04-15</date><risdate>2023</risdate><volume>189</volume><spage>110059</spage><pages>110059-</pages><artnum>110059</artnum><issn>0888-3270</issn><eissn>1096-1216</eissn><abstract>Full-field discrete measurements of the continuous spatiotemporal response of physical processes often generate large datasets. Such continuous spatiotemporal dynamic models are represented by partial differential equations (PDEs). In the past, attempts have been made to identify the PDE models from the measured response by inferring its parameters via regression or deep learning-based techniques. But the previously presented regression-based methods fail to estimate the parameters of the higher-order PDE models in the presence of moderate noise. Likewise, the deep learning-based methods lack the much-needed property of repeatability and robustness in the identification of PDE models from the measured response. The proposed method of SimultaNeous Basis Function Approximation and Parameter Estimation (SNAPE) addresses such drawbacks by simultaneously fitting basis functions to the measured response and estimating the parameters of both ordinary and partial differential equations. The domain knowledge of the general multidimensional process is used as a constraint in the formulation of the optimization framework. The alternating direction method of multipliers (ADMM) algorithm is used to simultaneously optimize the loss function over the parameter space of the PDE model and coefficient space of the basis functions. The proposed method not only infers the parameters but also estimates a continuous function that approximates the solution to the PDE model. SNAPE not only demonstrates its applicability on various complex dynamic systems that encompass wide scientific domains including Schrödinger equation, chaotic duffing oscillator, and Navier–Stokes equation but also estimates an analytical approximation to the process response. The method systematically combines the knowledge of well-established scientific theories and the concepts of data science to infer the properties of the process from the observed data.
•Parameter estimation of partial differential equation (PDE) models from noisy data.•Bi-convex optimization adopts the alternating direction method of multipliers (ADMM).•Simultaneously estimates an analytical approximation of the PDE solution.•Demonstrated on a wide variety of nonlinear PDE models.•Systematically combines domain knowledge and concepts of data science.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.ymssp.2022.110059</doi><orcidid>https://orcid.org/0000-0003-0088-1656</orcidid><orcidid>https://orcid.org/0000-0001-9350-4803</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0888-3270 |
ispartof | Mechanical systems and signal processing, 2023-04, Vol.189, p.110059, Article 110059 |
issn | 0888-3270 1096-1216 |
language | eng |
recordid | cdi_crossref_primary_10_1016_j_ymssp_2022_110059 |
source | ScienceDirect Freedom Collection |
subjects | ADMM optimization Basis function approximation Parameter estimation Partial differential equations Theory-guided learning |
title | Data- and theory-guided learning of partial differential equations using SimultaNeous basis function Approximation and Parameter Estimation (SNAPE) |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T23%3A53%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Data-%20and%20theory-guided%20learning%20of%20partial%20differential%20equations%20using%20SimultaNeous%20basis%20function%20Approximation%20and%20Parameter%20Estimation%20(SNAPE)&rft.jtitle=Mechanical%20systems%20and%20signal%20processing&rft.au=Bhowmick,%20Sutanu&rft.date=2023-04-15&rft.volume=189&rft.spage=110059&rft.pages=110059-&rft.artnum=110059&rft.issn=0888-3270&rft.eissn=1096-1216&rft_id=info:doi/10.1016/j.ymssp.2022.110059&rft_dat=%3Celsevier_cross%3ES088832702201127X%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c303t-94c987f79a9a8194fa40dccaf8988daa0daa1d58c90033d96e1049be3ce070a13%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |