A Good View for Graph Contrastive Learning. 2024

Xueyuan Chen, and Shangzhe Li
State Key Laboratory of Software Development Environment, Beihang University, Beijing 100191, China.

Due to the success observed in deep neural networks with contrastive learning, there has been a notable surge in research interest in graph contrastive learning, primarily attributed to its superior performance in graphs with limited labeled data. Within contrastive learning, the selection of a "view" dictates the information captured by the representation, thereby influencing the model's performance. However, assessing the quality of information in these views poses challenges, and determining what constitutes a good view remains unclear. This paper addresses this issue by establishing the definition of a good view through the application of graph information bottleneck and structural entropy theories. Based on theoretical insights, we introduce CtrlGCL, a novel method for achieving a beneficial view in graph contrastive learning through coding tree representation learning. Extensive experiments were conducted to ascertain the effectiveness of the proposed view in unsupervised and semi-supervised learning. In particular, our approach, via CtrlGCL-H, yields an average accuracy enhancement of 1.06% under unsupervised learning when compared to GCL. This improvement underscores the efficacy of our proposed method.

UI MeSH Term Description Entries

Related Publications

Xueyuan Chen, and Shangzhe Li
February 2024, IEEE transactions on neural networks and learning systems,
Xueyuan Chen, and Shangzhe Li
February 2022, Proceedings of the ... International Conference on Web Search & Data Mining. International Conference on Web Search & Data Mining,
Xueyuan Chen, and Shangzhe Li
April 2023, IEEE transactions on neural networks and learning systems,
Xueyuan Chen, and Shangzhe Li
February 2024, IEEE transactions on neural networks and learning systems,
Xueyuan Chen, and Shangzhe Li
June 2023, Neural networks : the official journal of the International Neural Network Society,
Xueyuan Chen, and Shangzhe Li
June 2023, IEEE transactions on neural networks and learning systems,
Xueyuan Chen, and Shangzhe Li
January 2022, Bioinformatics (Oxford, England),
Xueyuan Chen, and Shangzhe Li
October 2023, IEEE journal of biomedical and health informatics,
Xueyuan Chen, and Shangzhe Li
November 2023, International journal of neural systems,
Copied contents to your clipboard!