Transferable Linear Discriminant Analysis. 2020

Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li

Linear discriminant analysis (LDA) has been widely used as the technique of feature exaction. However, LDA may be invalid to address the data from different domains. The reasons are as follows: 1) the distribution discrepancy of data may disturb the linear transformation matrix so that it cannot extract the most discriminative feature and 2) the original design of LDA does not consider the unlabeled data so that the unlabeled data cannot take part in the training process for further improving the performance of LDA. To address these problems, in this brief, we propose a novel transferable LDA (TLDA) method to extend LDA into the scenario in which the data have different probability distributions. The whole learning process of TLDA is driven by the philosophy that the data from the same subspace have a low-rank structure. The matrix rank in TLDA is the key learning criterion to conduct local and global linear transformations for restoring the low-rank structure of data from different distributions and enlarging the distances among different subspaces. In doing so, the variations of distribution discrepancy within the same subspace can be reduced, i.e., data can be aligned well and the maximally separated structure can be achieved for the data from different subspaces. A simple projected subgradient-based method is proposed to optimize the objective of TLDA, and a strict theory proof is provided to guarantee a quick convergence. The experimental evaluation on public data sets demonstrates that our TLDA can achieve better classification performance and outperform the state-of-the-art methods.

UI MeSH Term Description Entries

Related Publications

Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li
January 2020, Technometrics : a journal of statistics for the physical, chemical, and engineering sciences,
Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li
December 2010, IEEE transactions on neural networks,
Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li
August 1971, Lancet (London, England),
Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li
April 1963, American journal of public health and the nation's health,
Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li
January 2008, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li
November 2019, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li
April 2008, IEEE transactions on pattern analysis and machine intelligence,
Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li
October 2022, IEEE transactions on cybernetics,
Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li
January 2021, Journal of applied statistics,
Na Han, and Jigang Wu, and Xiaozhao Fang, and Jie Wen, and Shanhua Zhan, and Shengli Xie, and Xuelong Li
February 2008, IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society,
Copied contents to your clipboard!