eVAE: Evolutionary Variational Autoencoder. 2025

Zhangkai Wu, and Longbing Cao, and Lei Qi

Variational autoencoders (VAEs) are challenged by the imbalance between representation inference and task fitting caused by surrogate loss. To address this issue, existing methods adjust their balance by directly tuning their coefficients. However, these methods suffer from a tradeoff uncertainty, i.e., nondynamic regulation over iterations and inflexible hyperparameters for learning tasks. Accordingly, we make the first attempt to introduce an evolutionary VAE (eVAE), building on the variational information bottleneck (VIB) theory and integrative evolutionary neural learning. eVAE integrates a variational genetic algorithm (VGA) into VAE with variational evolutionary operators, including variational mutation (V-mutation), crossover, and evolution. Its training mechanism synergistically and dynamically addresses and updates the learning tradeoff uncertainty in the evidence lower bound (ELBO) without additional constraints and hyperparameter tuning. Furthermore, eVAE presents an evolutionary paradigm to tune critical factors of VAEs and addresses the premature convergence and random search problem in integrating evolutionary optimization into deep learning. Experiments show that eVAE addresses the KL-vanishing problem for text generation with low reconstruction loss, generates all the disentangled factors with sharp images, and improves image generation quality. eVAE achieves better disentanglement, generation performance, and generation-inference balance than its competitors. Code available at: https://github.com/amasawa/eVAE.

UI MeSH Term Description Entries

Related Publications

Zhangkai Wu, and Longbing Cao, and Lei Qi
October 2022, Diagnostics (Basel, Switzerland),
Zhangkai Wu, and Longbing Cao, and Lei Qi
December 2024, ArXiv,
Zhangkai Wu, and Longbing Cao, and Lei Qi
January 2020, IEEE transactions on neural networks and learning systems,
Zhangkai Wu, and Longbing Cao, and Lei Qi
March 2021, Accident; analysis and prevention,
Zhangkai Wu, and Longbing Cao, and Lei Qi
February 2024, Cell reports methods,
Zhangkai Wu, and Longbing Cao, and Lei Qi
January 2025, Proceedings of the ... AAAI Conference on Artificial Intelligence. AAAI Conference on Artificial Intelligence,
Zhangkai Wu, and Longbing Cao, and Lei Qi
August 2020, ACS omega,
Zhangkai Wu, and Longbing Cao, and Lei Qi
May 2022, IEEE transactions on cybernetics,
Zhangkai Wu, and Longbing Cao, and Lei Qi
August 2022, IEEE transactions on pattern analysis and machine intelligence,
Zhangkai Wu, and Longbing Cao, and Lei Qi
February 2022, Knowledge-based systems,
Copied contents to your clipboard!