Predicate Correlation Learning for Scene Graph Generation. 2022

Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen

For a typical Scene Graph Generation (SGG) method in image understanding, there usually exists a large gap in the performance of the predicates' head classes and tail classes. This phenomenon is mainly caused by the semantic overlap between different predicates as well as the long-tailed data distribution. In this paper, a Predicate Correlation Learning (PCL) method for SGG is proposed to address the above problems by taking the correlation between predicates into consideration. To measure the semantic overlap between highly correlated predicate classes, a Predicate Correlation Matrix (PCM) is defined to quantify the relationship between predicate pairs, which is dynamically updated to remove the matrix's long-tailed bias. In addition, PCM is integrated into a predicate correlation loss function ( LPC ) to reduce discouraging gradients of unannotated classes. The proposed method is evaluated on several benchmarks, where the performance of the tail classes is significantly improved when built on existing methods.

UI MeSH Term Description Entries

Related Publications

Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen
October 2023, IEEE transactions on pattern analysis and machine intelligence,
Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen
January 2025, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen
April 2023, IEEE transactions on pattern analysis and machine intelligence,
Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen
February 2024, IEEE transactions on pattern analysis and machine intelligence,
Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen
January 2024, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen
November 2023, IEEE transactions on pattern analysis and machine intelligence,
Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen
December 2022, IEEE transactions on neural networks and learning systems,
Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen
January 2023, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen
July 2022, IEEE transactions on cybernetics,
Leitian Tao, and Li Mi, and Nannan Li, and Xianhang Cheng, and Yaosi Hu, and Zhenzhong Chen
September 2023, IEEE transactions on pattern analysis and machine intelligence,
Copied contents to your clipboard!