Enhancing framelet GCNs with generalized p-Laplacian regularization

Graph neural networks (GNNs) have achieved remarkable results for various graph learning tasks. However, one of the recent challenges for GNNs is to adapt to different types of graph inputs, such as heterophilic graph datasets in which linked nodes are more likely to contain a different class of lab...

Full description

Saved in:
Bibliographic Details
Published in:International journal of machine learning and cybernetics 2024-04, Vol.15 (4), p.1553-1573
Main Authors: Shao, Zhiqi, Shi, Dai, Han, Andi, Vasnev, Andrey, Guo, Yi, Gao, Junbin
Format: Article
Language:English
Subjects:
Algorithms
Artificial Intelligence
Cognitive tasks
Complex Systems
Computational Intelligence
Control
Datasets
Empirical analysis
Engineering
Graph neural networks
Graphs
Labels
Machine learning
Mechatronics
Neural networks
Noise reduction
Optimization
Original Article
Pattern Recognition
Regularization
Robotics
Solution space
Systems Biology
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Graph neural networks (GNNs) have achieved remarkable results for various graph learning tasks. However, one of the recent challenges for GNNs is to adapt to different types of graph inputs, such as heterophilic graph datasets in which linked nodes are more likely to contain a different class of labels and features. Accordingly, an ideal GNN model should adaptively accommodate all types of graph datasets with different labeling distributions. In this paper, we tackle this challenge by proposing a regularization framework on graph framelet with the regularizer induced from graph p -Laplacian. By adjusting the value of p , the p -Laplacian based regularizer restricts the solution space of graph framelet into the desirable region based on the graph homophilic features. We propose an algorithm to effectively solve a more generalized regularization problem and prove that the algorithm imposes a ( p -Laplacian based) spectral convolution and diagonal scaling operation to the framelet filtered node features. Furthermore, we analyze the denoising power of the proposed model and compare it with the predefined framelet denoising regularizer. Finally, we conduct empirical studies to show the prediction power of the proposed model in both homophily undirect and heterophily direct graphs with and without noises. Our proposed model shows significant improvements compared to multiple baselines, and this suggests the effectiveness of combining graph framelet and p -Laplacian.
ISSN:1868-8071
1868-808X
DOI:10.1007/s13042-023-01982-8