Sensing prior constraints in deep neural networks for solving exploration geophysical problems

• Published in: Proceedings of the National Academy of Sciences - PNAS 2023-06, Vol.120 (23), p.e2219573120-e2219573120
• Main Authors: Wu, Xinming, Ma, Jianwei, Si, Xu, Bi, Zhengfa, Yang, Jiarun, Gao, Hui, Xie, Dongzi, Guo, Zhixiang, Zhang, Jie
• Format: Article
• Language: English
• Subjects: Artificial neural networks; Data acquisition; Data processing; Deep learning; Feature maps; Geology; Geophysics; Machine learning; Neural networks; Physical Sciences; Regularization; Training
• ISSN: 0027-8424; 1091-6490
• DOI: 10.1073/pnas.2219573120

One of the key objectives in geophysics is to characterize the subsurface through the process of analyzing and interpreting geophysical field data that are typically acquired at the surface. Data-driven deep learning methods have enormous potential for accelerating and simplifying the process but also face many challenges, including poor generalizability, weak interpretability, and physical inconsistency. We present three strategies for imposing domain knowledge constraints on deep neural networks (DNNs) to help address these challenges. The first strategy is to integrate constraints into data by generating synthetic training datasets through geological and geophysical forward modeling and properly encoding prior knowledge as part of the input fed into the DNNs. The second strategy is to design nontrainable custom layers of physical operators and preconditioners in the DNN architecture to modify or shape feature maps calculated within the network to make them consistent with the prior knowledge. The final strategy is to implement prior geological information and geophysical laws as regularization terms in loss functions for training the DNNs. We discuss the implementation of these strategies in detail and demonstrate their effectiveness by applying them to geophysical data processing, imaging, interpretation, and subsurface model building.