从认识论出发,提出新方法实现更可解释的解耦表征学习
Independence Constrained Disentangled Representation Learning from Epistemological Perspective
- 构建两层潜在空间,融合互信息与独立性约束
- 在多个指标上优于基线,显著提升语义因子解耦能力
- 适合关注模型可解释性与可控生成的研究者
解耦表征学习旨在通过训练数据编码器识别数据生成过程中的语义有意义的潜在变量,以提升深度学习方法的可解释性。然而,关于解耦表征学习的目标尚无普遍接受的定义,特别是潜在变量是否应相互独立存在较大争议。本文首先通过建立认识论与解耦表征学习之间的概念桥梁,探讨潜在变量间关系的理论基础;随后,受跨学科思想启发,提出一个两层潜在空间框架,为该争议提供通用解决方案;最后,在生成对抗网络(GAN)框架中,结合互信息约束与独立性约束,提出一种新型解耦表征学习方法。实验结果表明,所提方法在定量和定性评估中均持续优于基线方法,在多个常用指标上表现优异,具备强大的语义因子解耦能力,显著提升了可控生成质量,从而增强了算法的可解释性。
原文摘要 · Abstract (English)
Disentangled Representation Learning aims to improve the explainability of deep learning methods by training a data encoder that identifies semantically meaningful latent variables in the data generation process. Nevertheless, there is no consensus regarding a universally accepted definition for the objective of disentangled representation learning. In particular, there is a considerable amount of discourse regarding whether should the latent variables be mutually independent or not. In this paper, we first investigate these arguments on the interrelationships between latent variables by establishing a conceptual bridge between Epistemology and Disentangled Representation Learning. Then, inspired by these interdisciplinary concepts, we introduce a two-level latent space framework to provide a general solution to the prior arguments on this issue. Finally, we propose a novel method for disentangled representation learning by employing an integration of mutual information constraint and independence constraint within the Generative Adversarial Network (GAN) framework. Experimental results demonstrate that our proposed method consistently outperforms baseline approaches in both quantitative and qualitative evaluations. The method exhibits strong performance across multiple commonly used metrics and demonstrates a great capability in disentangling various semantic factors, leading to an improved quality of controllable generation, which consequently benefits the explainability of the algorithm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。