Loading…
Physics-informed neural networks with adaptive localized artificial viscosity
Physics-informed Neural Network (PINN) is a promising tool that has been applied in a variety of physical phenomena described by partial differential equations (PDE). However, it has been observed that PINNs are difficult to train in certain “stiff” problems, which include various nonlinear hyperbol...
Saved in:
Published in: | Journal of computational physics 2023-09, Vol.489, p.112265, Article 112265 |
---|---|
Main Authors: | , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3 |
---|---|
cites | cdi_FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3 |
container_end_page | |
container_issue | |
container_start_page | 112265 |
container_title | Journal of computational physics |
container_volume | 489 |
creator | Coutinho, Emilio Jose Rocha Dall'Aqua, Marcelo McClenny, Levi Zhong, Ming Braga-Neto, Ulisses Gildin, Eduardo |
description | Physics-informed Neural Network (PINN) is a promising tool that has been applied in a variety of physical phenomena described by partial differential equations (PDE). However, it has been observed that PINNs are difficult to train in certain “stiff” problems, which include various nonlinear hyperbolic PDEs that display shocks in their solutions. Recent studies added a diffusion term to the PDE, and an artificial viscosity (AV) value was manually tuned to allow PINNs to solve these problems. In this paper, we propose three approaches to address this problem, none of which rely on an a priori definition of the artificial viscosity value. The first method learns a global AV value, whereas the other two learn localized AV values around the shocks, by means of a parametrized AV map or a residual-based AV map. We applied the proposed methods to the inviscid Burgers equation and the Buckley-Leverett equation, the latter being a classical problem in Petroleum Engineering. The results show that the proposed methods are able to learn both a small AV value and the accurate shock location and improve the approximation error over a nonadaptive global AV alternative method.
•Methods to add adaptive artificial viscosity to train PINNs to solve hyperbolic PDEs with shocks.•Adaptive methods accurately learn both the value and location of the artificial viscosity.•Successfully solved the Inviscid Burgers and Buckley-Leverett equations.•Additional computation cost over the baseline PINN is small. |
doi_str_mv | 10.1016/j.jcp.2023.112265 |
format | article |
fullrecord | <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_jcp_2023_112265</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0021999123003601</els_id><sourcerecordid>S0021999123003601</sourcerecordid><originalsourceid>FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3</originalsourceid><addsrcrecordid>eNp9kMlOwzAURS0EEmX4AHb5gYTnIYPFClVMUhEsYG05z476QtpUtmlVvp5UZc3qbu65ujqM3XAoOPDqti963BQChCw4F6IqT9iMg4Zc1Lw6ZTMAwXOtNT9nFzH2ANCUqpmx1_flPhLGnNbdGFbeZWv_HewwRdqN4StmO0rLzDq7SbT12TCiHehn6tmQqCOkqbuliGOktL9iZ50dor_-y0v2-fjwMX_OF29PL_P7RY5SQcqxtnWNvmmwQad0i7pWVVv6DpXnrQetnBQCbM3BubbUjZBaWimVdkqVystLxo-7GMYYg-_MJtDKhr3hYA4-TG8mH-bgwxx9TMzdkfHTsS35YCKSX6N3FDwm40b6h_4FbWxp8A</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Physics-informed neural networks with adaptive localized artificial viscosity</title><source>ScienceDirect Freedom Collection</source><creator>Coutinho, Emilio Jose Rocha ; Dall'Aqua, Marcelo ; McClenny, Levi ; Zhong, Ming ; Braga-Neto, Ulisses ; Gildin, Eduardo</creator><creatorcontrib>Coutinho, Emilio Jose Rocha ; Dall'Aqua, Marcelo ; McClenny, Levi ; Zhong, Ming ; Braga-Neto, Ulisses ; Gildin, Eduardo</creatorcontrib><description>Physics-informed Neural Network (PINN) is a promising tool that has been applied in a variety of physical phenomena described by partial differential equations (PDE). However, it has been observed that PINNs are difficult to train in certain “stiff” problems, which include various nonlinear hyperbolic PDEs that display shocks in their solutions. Recent studies added a diffusion term to the PDE, and an artificial viscosity (AV) value was manually tuned to allow PINNs to solve these problems. In this paper, we propose three approaches to address this problem, none of which rely on an a priori definition of the artificial viscosity value. The first method learns a global AV value, whereas the other two learn localized AV values around the shocks, by means of a parametrized AV map or a residual-based AV map. We applied the proposed methods to the inviscid Burgers equation and the Buckley-Leverett equation, the latter being a classical problem in Petroleum Engineering. The results show that the proposed methods are able to learn both a small AV value and the accurate shock location and improve the approximation error over a nonadaptive global AV alternative method.
•Methods to add adaptive artificial viscosity to train PINNs to solve hyperbolic PDEs with shocks.•Adaptive methods accurately learn both the value and location of the artificial viscosity.•Successfully solved the Inviscid Burgers and Buckley-Leverett equations.•Additional computation cost over the baseline PINN is small.</description><identifier>ISSN: 0021-9991</identifier><identifier>EISSN: 1090-2716</identifier><identifier>DOI: 10.1016/j.jcp.2023.112265</identifier><language>eng</language><publisher>Elsevier Inc</publisher><subject>Artificial viscosity ; Hyperbolic PDEs ; Physics-informed neural networks</subject><ispartof>Journal of computational physics, 2023-09, Vol.489, p.112265, Article 112265</ispartof><rights>2023 Elsevier Inc.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3</citedby><cites>FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3</cites><orcidid>0000-0001-7326-3993</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Coutinho, Emilio Jose Rocha</creatorcontrib><creatorcontrib>Dall'Aqua, Marcelo</creatorcontrib><creatorcontrib>McClenny, Levi</creatorcontrib><creatorcontrib>Zhong, Ming</creatorcontrib><creatorcontrib>Braga-Neto, Ulisses</creatorcontrib><creatorcontrib>Gildin, Eduardo</creatorcontrib><title>Physics-informed neural networks with adaptive localized artificial viscosity</title><title>Journal of computational physics</title><description>Physics-informed Neural Network (PINN) is a promising tool that has been applied in a variety of physical phenomena described by partial differential equations (PDE). However, it has been observed that PINNs are difficult to train in certain “stiff” problems, which include various nonlinear hyperbolic PDEs that display shocks in their solutions. Recent studies added a diffusion term to the PDE, and an artificial viscosity (AV) value was manually tuned to allow PINNs to solve these problems. In this paper, we propose three approaches to address this problem, none of which rely on an a priori definition of the artificial viscosity value. The first method learns a global AV value, whereas the other two learn localized AV values around the shocks, by means of a parametrized AV map or a residual-based AV map. We applied the proposed methods to the inviscid Burgers equation and the Buckley-Leverett equation, the latter being a classical problem in Petroleum Engineering. The results show that the proposed methods are able to learn both a small AV value and the accurate shock location and improve the approximation error over a nonadaptive global AV alternative method.
•Methods to add adaptive artificial viscosity to train PINNs to solve hyperbolic PDEs with shocks.•Adaptive methods accurately learn both the value and location of the artificial viscosity.•Successfully solved the Inviscid Burgers and Buckley-Leverett equations.•Additional computation cost over the baseline PINN is small.</description><subject>Artificial viscosity</subject><subject>Hyperbolic PDEs</subject><subject>Physics-informed neural networks</subject><issn>0021-9991</issn><issn>1090-2716</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNp9kMlOwzAURS0EEmX4AHb5gYTnIYPFClVMUhEsYG05z476QtpUtmlVvp5UZc3qbu65ujqM3XAoOPDqti963BQChCw4F6IqT9iMg4Zc1Lw6ZTMAwXOtNT9nFzH2ANCUqpmx1_flPhLGnNbdGFbeZWv_HewwRdqN4StmO0rLzDq7SbT12TCiHehn6tmQqCOkqbuliGOktL9iZ50dor_-y0v2-fjwMX_OF29PL_P7RY5SQcqxtnWNvmmwQad0i7pWVVv6DpXnrQetnBQCbM3BubbUjZBaWimVdkqVystLxo-7GMYYg-_MJtDKhr3hYA4-TG8mH-bgwxx9TMzdkfHTsS35YCKSX6N3FDwm40b6h_4FbWxp8A</recordid><startdate>20230915</startdate><enddate>20230915</enddate><creator>Coutinho, Emilio Jose Rocha</creator><creator>Dall'Aqua, Marcelo</creator><creator>McClenny, Levi</creator><creator>Zhong, Ming</creator><creator>Braga-Neto, Ulisses</creator><creator>Gildin, Eduardo</creator><general>Elsevier Inc</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0001-7326-3993</orcidid></search><sort><creationdate>20230915</creationdate><title>Physics-informed neural networks with adaptive localized artificial viscosity</title><author>Coutinho, Emilio Jose Rocha ; Dall'Aqua, Marcelo ; McClenny, Levi ; Zhong, Ming ; Braga-Neto, Ulisses ; Gildin, Eduardo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Artificial viscosity</topic><topic>Hyperbolic PDEs</topic><topic>Physics-informed neural networks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Coutinho, Emilio Jose Rocha</creatorcontrib><creatorcontrib>Dall'Aqua, Marcelo</creatorcontrib><creatorcontrib>McClenny, Levi</creatorcontrib><creatorcontrib>Zhong, Ming</creatorcontrib><creatorcontrib>Braga-Neto, Ulisses</creatorcontrib><creatorcontrib>Gildin, Eduardo</creatorcontrib><collection>CrossRef</collection><jtitle>Journal of computational physics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Coutinho, Emilio Jose Rocha</au><au>Dall'Aqua, Marcelo</au><au>McClenny, Levi</au><au>Zhong, Ming</au><au>Braga-Neto, Ulisses</au><au>Gildin, Eduardo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Physics-informed neural networks with adaptive localized artificial viscosity</atitle><jtitle>Journal of computational physics</jtitle><date>2023-09-15</date><risdate>2023</risdate><volume>489</volume><spage>112265</spage><pages>112265-</pages><artnum>112265</artnum><issn>0021-9991</issn><eissn>1090-2716</eissn><abstract>Physics-informed Neural Network (PINN) is a promising tool that has been applied in a variety of physical phenomena described by partial differential equations (PDE). However, it has been observed that PINNs are difficult to train in certain “stiff” problems, which include various nonlinear hyperbolic PDEs that display shocks in their solutions. Recent studies added a diffusion term to the PDE, and an artificial viscosity (AV) value was manually tuned to allow PINNs to solve these problems. In this paper, we propose three approaches to address this problem, none of which rely on an a priori definition of the artificial viscosity value. The first method learns a global AV value, whereas the other two learn localized AV values around the shocks, by means of a parametrized AV map or a residual-based AV map. We applied the proposed methods to the inviscid Burgers equation and the Buckley-Leverett equation, the latter being a classical problem in Petroleum Engineering. The results show that the proposed methods are able to learn both a small AV value and the accurate shock location and improve the approximation error over a nonadaptive global AV alternative method.
•Methods to add adaptive artificial viscosity to train PINNs to solve hyperbolic PDEs with shocks.•Adaptive methods accurately learn both the value and location of the artificial viscosity.•Successfully solved the Inviscid Burgers and Buckley-Leverett equations.•Additional computation cost over the baseline PINN is small.</abstract><pub>Elsevier Inc</pub><doi>10.1016/j.jcp.2023.112265</doi><orcidid>https://orcid.org/0000-0001-7326-3993</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0021-9991 |
ispartof | Journal of computational physics, 2023-09, Vol.489, p.112265, Article 112265 |
issn | 0021-9991 1090-2716 |
language | eng |
recordid | cdi_crossref_primary_10_1016_j_jcp_2023_112265 |
source | ScienceDirect Freedom Collection |
subjects | Artificial viscosity Hyperbolic PDEs Physics-informed neural networks |
title | Physics-informed neural networks with adaptive localized artificial viscosity |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T15%3A08%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Physics-informed%20neural%20networks%20with%20adaptive%20localized%20artificial%20viscosity&rft.jtitle=Journal%20of%20computational%20physics&rft.au=Coutinho,%20Emilio%20Jose%20Rocha&rft.date=2023-09-15&rft.volume=489&rft.spage=112265&rft.pages=112265-&rft.artnum=112265&rft.issn=0021-9991&rft.eissn=1090-2716&rft_id=info:doi/10.1016/j.jcp.2023.112265&rft_dat=%3Celsevier_cross%3ES0021999123003601%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |