Loading…

Physics-informed neural networks with adaptive localized artificial viscosity

Physics-informed Neural Network (PINN) is a promising tool that has been applied in a variety of physical phenomena described by partial differential equations (PDE). However, it has been observed that PINNs are difficult to train in certain “stiff” problems, which include various nonlinear hyperbol...

Full description

Saved in:
Bibliographic Details
Published in:Journal of computational physics 2023-09, Vol.489, p.112265, Article 112265
Main Authors: Coutinho, Emilio Jose Rocha, Dall'Aqua, Marcelo, McClenny, Levi, Zhong, Ming, Braga-Neto, Ulisses, Gildin, Eduardo
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3
cites cdi_FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3
container_end_page
container_issue
container_start_page 112265
container_title Journal of computational physics
container_volume 489
creator Coutinho, Emilio Jose Rocha
Dall'Aqua, Marcelo
McClenny, Levi
Zhong, Ming
Braga-Neto, Ulisses
Gildin, Eduardo
description Physics-informed Neural Network (PINN) is a promising tool that has been applied in a variety of physical phenomena described by partial differential equations (PDE). However, it has been observed that PINNs are difficult to train in certain “stiff” problems, which include various nonlinear hyperbolic PDEs that display shocks in their solutions. Recent studies added a diffusion term to the PDE, and an artificial viscosity (AV) value was manually tuned to allow PINNs to solve these problems. In this paper, we propose three approaches to address this problem, none of which rely on an a priori definition of the artificial viscosity value. The first method learns a global AV value, whereas the other two learn localized AV values around the shocks, by means of a parametrized AV map or a residual-based AV map. We applied the proposed methods to the inviscid Burgers equation and the Buckley-Leverett equation, the latter being a classical problem in Petroleum Engineering. The results show that the proposed methods are able to learn both a small AV value and the accurate shock location and improve the approximation error over a nonadaptive global AV alternative method. •Methods to add adaptive artificial viscosity to train PINNs to solve hyperbolic PDEs with shocks.•Adaptive methods accurately learn both the value and location of the artificial viscosity.•Successfully solved the Inviscid Burgers and Buckley-Leverett equations.•Additional computation cost over the baseline PINN is small.
doi_str_mv 10.1016/j.jcp.2023.112265
format article
fullrecord <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_jcp_2023_112265</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0021999123003601</els_id><sourcerecordid>S0021999123003601</sourcerecordid><originalsourceid>FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3</originalsourceid><addsrcrecordid>eNp9kMlOwzAURS0EEmX4AHb5gYTnIYPFClVMUhEsYG05z476QtpUtmlVvp5UZc3qbu65ujqM3XAoOPDqti963BQChCw4F6IqT9iMg4Zc1Lw6ZTMAwXOtNT9nFzH2ANCUqpmx1_flPhLGnNbdGFbeZWv_HewwRdqN4StmO0rLzDq7SbT12TCiHehn6tmQqCOkqbuliGOktL9iZ50dor_-y0v2-fjwMX_OF29PL_P7RY5SQcqxtnWNvmmwQad0i7pWVVv6DpXnrQetnBQCbM3BubbUjZBaWimVdkqVystLxo-7GMYYg-_MJtDKhr3hYA4-TG8mH-bgwxx9TMzdkfHTsS35YCKSX6N3FDwm40b6h_4FbWxp8A</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Physics-informed neural networks with adaptive localized artificial viscosity</title><source>ScienceDirect Freedom Collection</source><creator>Coutinho, Emilio Jose Rocha ; Dall'Aqua, Marcelo ; McClenny, Levi ; Zhong, Ming ; Braga-Neto, Ulisses ; Gildin, Eduardo</creator><creatorcontrib>Coutinho, Emilio Jose Rocha ; Dall'Aqua, Marcelo ; McClenny, Levi ; Zhong, Ming ; Braga-Neto, Ulisses ; Gildin, Eduardo</creatorcontrib><description>Physics-informed Neural Network (PINN) is a promising tool that has been applied in a variety of physical phenomena described by partial differential equations (PDE). However, it has been observed that PINNs are difficult to train in certain “stiff” problems, which include various nonlinear hyperbolic PDEs that display shocks in their solutions. Recent studies added a diffusion term to the PDE, and an artificial viscosity (AV) value was manually tuned to allow PINNs to solve these problems. In this paper, we propose three approaches to address this problem, none of which rely on an a priori definition of the artificial viscosity value. The first method learns a global AV value, whereas the other two learn localized AV values around the shocks, by means of a parametrized AV map or a residual-based AV map. We applied the proposed methods to the inviscid Burgers equation and the Buckley-Leverett equation, the latter being a classical problem in Petroleum Engineering. The results show that the proposed methods are able to learn both a small AV value and the accurate shock location and improve the approximation error over a nonadaptive global AV alternative method. •Methods to add adaptive artificial viscosity to train PINNs to solve hyperbolic PDEs with shocks.•Adaptive methods accurately learn both the value and location of the artificial viscosity.•Successfully solved the Inviscid Burgers and Buckley-Leverett equations.•Additional computation cost over the baseline PINN is small.</description><identifier>ISSN: 0021-9991</identifier><identifier>EISSN: 1090-2716</identifier><identifier>DOI: 10.1016/j.jcp.2023.112265</identifier><language>eng</language><publisher>Elsevier Inc</publisher><subject>Artificial viscosity ; Hyperbolic PDEs ; Physics-informed neural networks</subject><ispartof>Journal of computational physics, 2023-09, Vol.489, p.112265, Article 112265</ispartof><rights>2023 Elsevier Inc.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3</citedby><cites>FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3</cites><orcidid>0000-0001-7326-3993</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Coutinho, Emilio Jose Rocha</creatorcontrib><creatorcontrib>Dall'Aqua, Marcelo</creatorcontrib><creatorcontrib>McClenny, Levi</creatorcontrib><creatorcontrib>Zhong, Ming</creatorcontrib><creatorcontrib>Braga-Neto, Ulisses</creatorcontrib><creatorcontrib>Gildin, Eduardo</creatorcontrib><title>Physics-informed neural networks with adaptive localized artificial viscosity</title><title>Journal of computational physics</title><description>Physics-informed Neural Network (PINN) is a promising tool that has been applied in a variety of physical phenomena described by partial differential equations (PDE). However, it has been observed that PINNs are difficult to train in certain “stiff” problems, which include various nonlinear hyperbolic PDEs that display shocks in their solutions. Recent studies added a diffusion term to the PDE, and an artificial viscosity (AV) value was manually tuned to allow PINNs to solve these problems. In this paper, we propose three approaches to address this problem, none of which rely on an a priori definition of the artificial viscosity value. The first method learns a global AV value, whereas the other two learn localized AV values around the shocks, by means of a parametrized AV map or a residual-based AV map. We applied the proposed methods to the inviscid Burgers equation and the Buckley-Leverett equation, the latter being a classical problem in Petroleum Engineering. The results show that the proposed methods are able to learn both a small AV value and the accurate shock location and improve the approximation error over a nonadaptive global AV alternative method. •Methods to add adaptive artificial viscosity to train PINNs to solve hyperbolic PDEs with shocks.•Adaptive methods accurately learn both the value and location of the artificial viscosity.•Successfully solved the Inviscid Burgers and Buckley-Leverett equations.•Additional computation cost over the baseline PINN is small.</description><subject>Artificial viscosity</subject><subject>Hyperbolic PDEs</subject><subject>Physics-informed neural networks</subject><issn>0021-9991</issn><issn>1090-2716</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNp9kMlOwzAURS0EEmX4AHb5gYTnIYPFClVMUhEsYG05z476QtpUtmlVvp5UZc3qbu65ujqM3XAoOPDqti963BQChCw4F6IqT9iMg4Zc1Lw6ZTMAwXOtNT9nFzH2ANCUqpmx1_flPhLGnNbdGFbeZWv_HewwRdqN4StmO0rLzDq7SbT12TCiHehn6tmQqCOkqbuliGOktL9iZ50dor_-y0v2-fjwMX_OF29PL_P7RY5SQcqxtnWNvmmwQad0i7pWVVv6DpXnrQetnBQCbM3BubbUjZBaWimVdkqVystLxo-7GMYYg-_MJtDKhr3hYA4-TG8mH-bgwxx9TMzdkfHTsS35YCKSX6N3FDwm40b6h_4FbWxp8A</recordid><startdate>20230915</startdate><enddate>20230915</enddate><creator>Coutinho, Emilio Jose Rocha</creator><creator>Dall'Aqua, Marcelo</creator><creator>McClenny, Levi</creator><creator>Zhong, Ming</creator><creator>Braga-Neto, Ulisses</creator><creator>Gildin, Eduardo</creator><general>Elsevier Inc</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0001-7326-3993</orcidid></search><sort><creationdate>20230915</creationdate><title>Physics-informed neural networks with adaptive localized artificial viscosity</title><author>Coutinho, Emilio Jose Rocha ; Dall'Aqua, Marcelo ; McClenny, Levi ; Zhong, Ming ; Braga-Neto, Ulisses ; Gildin, Eduardo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Artificial viscosity</topic><topic>Hyperbolic PDEs</topic><topic>Physics-informed neural networks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Coutinho, Emilio Jose Rocha</creatorcontrib><creatorcontrib>Dall'Aqua, Marcelo</creatorcontrib><creatorcontrib>McClenny, Levi</creatorcontrib><creatorcontrib>Zhong, Ming</creatorcontrib><creatorcontrib>Braga-Neto, Ulisses</creatorcontrib><creatorcontrib>Gildin, Eduardo</creatorcontrib><collection>CrossRef</collection><jtitle>Journal of computational physics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Coutinho, Emilio Jose Rocha</au><au>Dall'Aqua, Marcelo</au><au>McClenny, Levi</au><au>Zhong, Ming</au><au>Braga-Neto, Ulisses</au><au>Gildin, Eduardo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Physics-informed neural networks with adaptive localized artificial viscosity</atitle><jtitle>Journal of computational physics</jtitle><date>2023-09-15</date><risdate>2023</risdate><volume>489</volume><spage>112265</spage><pages>112265-</pages><artnum>112265</artnum><issn>0021-9991</issn><eissn>1090-2716</eissn><abstract>Physics-informed Neural Network (PINN) is a promising tool that has been applied in a variety of physical phenomena described by partial differential equations (PDE). However, it has been observed that PINNs are difficult to train in certain “stiff” problems, which include various nonlinear hyperbolic PDEs that display shocks in their solutions. Recent studies added a diffusion term to the PDE, and an artificial viscosity (AV) value was manually tuned to allow PINNs to solve these problems. In this paper, we propose three approaches to address this problem, none of which rely on an a priori definition of the artificial viscosity value. The first method learns a global AV value, whereas the other two learn localized AV values around the shocks, by means of a parametrized AV map or a residual-based AV map. We applied the proposed methods to the inviscid Burgers equation and the Buckley-Leverett equation, the latter being a classical problem in Petroleum Engineering. The results show that the proposed methods are able to learn both a small AV value and the accurate shock location and improve the approximation error over a nonadaptive global AV alternative method. •Methods to add adaptive artificial viscosity to train PINNs to solve hyperbolic PDEs with shocks.•Adaptive methods accurately learn both the value and location of the artificial viscosity.•Successfully solved the Inviscid Burgers and Buckley-Leverett equations.•Additional computation cost over the baseline PINN is small.</abstract><pub>Elsevier Inc</pub><doi>10.1016/j.jcp.2023.112265</doi><orcidid>https://orcid.org/0000-0001-7326-3993</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0021-9991
ispartof Journal of computational physics, 2023-09, Vol.489, p.112265, Article 112265
issn 0021-9991
1090-2716
language eng
recordid cdi_crossref_primary_10_1016_j_jcp_2023_112265
source ScienceDirect Freedom Collection
subjects Artificial viscosity
Hyperbolic PDEs
Physics-informed neural networks
title Physics-informed neural networks with adaptive localized artificial viscosity
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T15%3A08%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Physics-informed%20neural%20networks%20with%20adaptive%20localized%20artificial%20viscosity&rft.jtitle=Journal%20of%20computational%20physics&rft.au=Coutinho,%20Emilio%20Jose%20Rocha&rft.date=2023-09-15&rft.volume=489&rft.spage=112265&rft.pages=112265-&rft.artnum=112265&rft.issn=0021-9991&rft.eissn=1090-2716&rft_id=info:doi/10.1016/j.jcp.2023.112265&rft_dat=%3Celsevier_cross%3ES0021999123003601%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c340t-c7a77ce88c8cd49bc9746b5efc4e1be094d3220a710ddb5982393a3349d4454e3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true