Contrastive Multi-View Kernel Learning. 2023

Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia

Kernel method is a proven technique in multi-view learning. It implicitly defines a Hilbert space where samples can be linearly separated. Most kernel-based multi-view learning algorithms compute a kernel function aggregating and compressing the views into a single kernel. However, existing approaches compute the kernels independently for each view. This ignores complementary information across views and thus may result in a bad kernel choice. In contrast, we propose the Contrastive Multi-view Kernel - a novel kernel function based on the emerging contrastive learning framework. The Contrastive Multi-view Kernel implicitly embeds the views into a joint semantic space where all of them resemble each other while promoting to learn diverse views. We validate the method's effectiveness in a large empirical study. It is worth noting that the proposed kernel functions share the types and parameters with traditional ones, making them fully compatible with existing kernel theory and application. On this basis, we also propose a contrastive multi-view clustering framework and instantiate it with multiple kernel k-means, achieving a promising performance. To the best of our knowledge, this is the first attempt to explore kernel generation in multi-view setting and the first approach to use contrastive learning for a multi-view kernel learning.

UI MeSH Term Description Entries
D000465 Algorithms A procedure consisting of a sequence of algebraic formulas and/or logical steps to calculate or determine a given task. Algorithm
D016000 Cluster Analysis A set of statistical methods used to group variables or observations into strongly inter-related subgroups. In epidemiology, it may be used to analyze a closely grouped series of events or cases of disease or other health-related phenomenon with well-defined distribution patterns in relation to time or place or both. Clustering,Analyses, Cluster,Analysis, Cluster,Cluster Analyses,Clusterings

Related Publications

Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia
November 2023, IEEE transactions on neural networks and learning systems,
Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia
April 2023, Scientific reports,
Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia
September 2023, Briefings in bioinformatics,
Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia
January 2023, IEEE/ACM transactions on computational biology and bioinformatics,
Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia
January 2024, Neural networks : the official journal of the International Neural Network Society,
Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia
October 2023, IEEE journal of biomedical and health informatics,
Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia
January 2024, Physics in medicine and biology,
Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia
May 2024, Briefings in bioinformatics,
Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia
December 2022, Journal of the Optical Society of America. A, Optics, image science, and vision,
Jiyuan Liu, and Xinwang Liu, and Yuexiang Yang, and Qing Liao, and Yuanqing Xia
February 2024, Entropy (Basel, Switzerland),
Copied contents to your clipboard!