Adversarial Entropy Optimization for Unsupervised Domain Adaptation. 2022

Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen

Domain adaptation is proposed to deal with the challenging problem where the probability distribution of the training source is different from the testing target. Recently, adversarial learning has become the dominating technique for domain adaptation. Usually, adversarial domain adaptation methods simultaneously train a feature learner and a domain discriminator to learn domain-invariant features. Accordingly, how to effectively train the domain-adversarial model to learn domain-invariant features becomes a challenge in the community. To this end, we propose in this article a novel domain adaptation scheme named adversarial entropy optimization (AEO) to address the challenge. Specifically, we minimize the entropy when samples are from the independent distributions of source domain or target domain to improve the discriminability of the model. At the same time, we maximize the entropy when features are from the combined distribution of source domain and target domain so that the domain discriminator can be confused and the transferability of representations can be promoted. This minimax regime is well matched with the core idea of adversarial learning, empowering our model with transferability as well as discriminability for domain adaptation tasks. Also, AEO is flexible and compatible with different deep networks and domain adaptation frameworks. Experiments on five data sets show that our method can achieve state-of-the-art performance across diverse domain adaptation tasks.

UI MeSH Term Description Entries

Related Publications

Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen
August 2023, IEEE transactions on neural networks and learning systems,
Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen
January 2023, Neural networks : the official journal of the International Neural Network Society,
Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen
August 2020, IEEE transactions on neural networks and learning systems,
Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen
November 2022, IEEE transactions on pattern analysis and machine intelligence,
Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen
November 2022, Medical image analysis,
Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen
November 2023, The Journal of the Acoustical Society of America,
Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen
June 2021, IEEE transactions on pattern analysis and machine intelligence,
Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen
December 2018, IEEE transactions on medical imaging,
Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen
January 2018, Computational intelligence and neuroscience,
Ao Ma, and Jingjing Li, and Ke Lu, and Lei Zhu, and Heng Tao Shen
March 2024, Medical physics,
Copied contents to your clipboard!