Multi-view graph representation with similarity diffusion for general zero-shot learning. 2023

Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
School of Software, Yunnan University, Kunming, 650500, China. Electronic address: yubeibei@mail.ynu.edu.cn.

Zero-shot learning (ZSL) aims to predict unseen classes without using samples of these classes in model training. The ZSL has been widely used in many knowledge-based models and applications to predict various parameters, including categories, subjects, and anomalies, in different domains. Nonetheless, most existing ZSL methods require the pre-defined semantics or attributes of particular data environments. Therefore, these methods are difficult to be applied to general data environments, such as ImageNet and other real-world datasets and applications. Recent research has tried to use open knowledge to enhance the ZSL methods to adapt it to an open data environment. However, the performance of these methods is relatively low, namely the accuracy is normally below 10%, which is due to the inadequate semantics that can be used from open knowledge. Moreover, the latest methods suffer from a significant "semantic gap" problem between the generated features of unseen classes and the real features of seen classes. To this end, this paper proposes a multi-view graph representation with a similarity diffusion model, applying the ZSL tasks to general data environments. This model applies a multi-view graph to enhance the semantics fully and proposes an innovative diffusion method to augment the graph representation. In addition, a feature diffusion method is proposed to augment the multi-view graph representation and bridge the semantic gap to realize zero-shot predicting. The results of numerous experiments in general data environments and on benchmark datasets show that the proposed method can achieve new state-of-the-art results in the field of general zero-shot learning. Furthermore, seven ablation studies analyze the effects of the settings and different modules of the proposed method on its performance in detail and prove the effectiveness of each module.

UI MeSH Term Description Entries
D007858 Learning Relatively permanent change in behavior that is the result of past experience or practice. The concept includes the acquisition of knowledge. Phenomenography
D004058 Diffusion The tendency of a gas or solute to pass from a point of higher pressure or concentration to a point of lower pressure or concentration and to distribute itself throughout the available space. Diffusion, especially FACILITATED DIFFUSION, is a major mechanism of BIOLOGICAL TRANSPORT. Diffusions
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D051188 Knowledge Bases Collections of facts, assumptions, beliefs, and heuristics that are used in combination with databases to achieve desired results, such as a diagnosis, an interpretation, or a solution to a problem (From McGraw Hill Dictionary of Scientific and Technical Terms, 6th ed). Knowledge Bases (Computer),Knowledgebases,Base, Knowledge,Base, Knowledge (Computer),Bases, Knowledge,Bases, Knowledge (Computer),Knowledge Base,Knowledge Base (Computer),Knowledgebase
D019359 Knowledge The body of truths or facts accumulated in the course of time, the cumulated sum of information, its volume and nature, in any civilization, period, or country. Epistemology
D019985 Benchmarking Method of measuring performance against established standards of best practice. Benchmarking, Health Care,Benchmarks,Best Practice Analysis,Metrics,Benchmark,Benchmarking, Healthcare,Analysis, Best Practice,Health Care Benchmarking,Healthcare Benchmarking

Related Publications

Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
November 2015, IEEE transactions on pattern analysis and machine intelligence,
Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
December 2020, Neural networks : the official journal of the International Neural Network Society,
Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
October 2023, Neural networks : the official journal of the International Neural Network Society,
Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
May 2023, Neural networks : the official journal of the International Neural Network Society,
Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
August 2025, IEEE transactions on neural networks and learning systems,
Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
March 2024, IEEE transactions on pattern analysis and machine intelligence,
Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
May 2024, Bioinformatics (Oxford, England),
Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
March 2025, IEEE journal of biomedical and health informatics,
Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
June 2025, IEEE transactions on neural networks and learning systems,
Beibei Yu, and Cheng Xie, and Peng Tang, and Haoran Duan
February 2022, Methods (San Diego, Calif.),
Copied contents to your clipboard!