Physics Enhanced Data-Driven Models With Variational Gaussian Processes

Centuries of development in natural sciences and mathematical modeling provide valuable domain expert knowledge that has yet to be explored for the development of machine learning models. When modeling complex physical systems, both domain knowledge and data provide necessary information about the s...

Full description

Saved in:
Bibliographic Details
Published in:IEEE open journal of the Industrial Electronics Society 2021, Vol.2, p.252-265
Main Authors: Marino, Daniel L., Manic, Milos
Format: Article
Language:English
Subjects:
Bayesian neural networks
Data models
domain knowledge
Domains
Estimation
Gaussian process
Gaussian processes
Industrial electronics
Knowledge
Machine learning
Mathematical model
Predictive models
System dynamics
Uncertainty
variational inference
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Centuries of development in natural sciences and mathematical modeling provide valuable domain expert knowledge that has yet to be explored for the development of machine learning models. When modeling complex physical systems, both domain knowledge and data provide necessary information about the system. In this paper, we present a data-driven model that takes advantage of partial domain knowledge in order to improve generalization and interpretability. The presented approach, which we call EVGP (Explicit Variational Gaussian Process), has the following advantages: 1) using available domain knowledge to improve the assumptions (inductive bias) of the model, 2) scalability to large datasets, 3) improved interpretability. We show how the EVGP model can be used to learn system dynamics using basic Newtonian mechanics as prior knowledge. We demonstrate how the addition of prior domain-knowledge to data-driven models outperforms purely data-driven models.
ISSN:2644-1284
2644-1284
DOI:10.1109/OJIES.2021.3064820