Semisupervised Text Classification by Variational Autoencoder. 2020

Weidi Xu, and Ying Tan

Semisupervised text classification has attracted much attention from the research community. In this paper, a novel model, the semisupervised sequential variational autoencoder (SSVAE), is proposed to tackle this problem. By treating the categorical label of unlabeled data as a discrete latent variable, the proposed model maximizes the variational evidence lower bound of the data likelihood, which implicitly derives the underlying label distribution for the unlabeled data. Analytical work indicates that the autoregressive nature of the sequential model is the crucial issue that renders the vanilla model ineffective. To remedy this, two types of decoders are investigated in the SSVAE model and verified. In addition, a reweighting approach is proposed to circumvent the credit assignment problem that occurs during the reconstruction procedure, which can further improve performance for sparse text data. Experimental results show that our method significantly improves the classification accuracy compared with other modern methods.

UI MeSH Term Description Entries

Related Publications

Weidi Xu, and Ying Tan
May 2022, IEEE transactions on cybernetics,
Weidi Xu, and Ying Tan
October 2022, IEEE transactions on cybernetics,
Weidi Xu, and Ying Tan
December 2024, ArXiv,
Weidi Xu, and Ying Tan
February 2025, IEEE transactions on neural networks and learning systems,
Weidi Xu, and Ying Tan
August 2020, Journal of computational biology : a journal of computational molecular cell biology,
Weidi Xu, and Ying Tan
March 2021, Accident; analysis and prevention,
Weidi Xu, and Ying Tan
February 2024, Cell reports methods,
Weidi Xu, and Ying Tan
January 2025, Proceedings of the ... AAAI Conference on Artificial Intelligence. AAAI Conference on Artificial Intelligence,
Copied contents to your clipboard!