arXiv:2503.00639cs.LGstat.ML2025-03ICLR被引 5

通过稀疏混合与分布变化协同,实现更鲁棒的解耦表征学习。

Synergy Between Sufficient Changes and Sparse Mixing Procedure for Disentangled Representation Learning

论文配图:Synergy Between Sufficient Changes and Sparse Mixing Procedure for Disentangled Representation Learning
图 1 · 摘自论文原文
  • 结合辅助变量的稀疏混合机制,缓解分布变化不足的问题。
  • 理论证明在较弱假设下仍可保证解耦识别性,适用于真实场景。
  • 基于VAE和GAN的两种实现,在合成与真实数据上验证有效。

解耦表征学习旨在发现观测数据背后的潜在变量,但通常需要强假设以保证识别性。一些方法依赖于由辅助变量(如域索引)指示的潜在变量分布的充分变化,但获取足够多域往往困难;另一些方法则利用混合过程的结构稀疏性假设,但实践中该约束常被违反。我们发现,这两种看似无关的假设实际上可互补以实现识别性。具体而言,当对辅助变量条件化时,稀疏混合假设为估计到真实潜在变量的映射提供了结构约束,从而弥补潜在分布变化不足的问题。基于此,我们提出了一个对分布变化和稀疏混合约束要求更低的识别性理论,增强了在真实场景中的适用性。此外,我们构建了一个包含域编码网络和稀疏混合约束的估计框架,并分别基于变分自编码器和生成对抗网络给出了两种实现。合成与真实数据集上的实验结果支持了我们的理论结论。

原文摘要 · Abstract (English)

Disentangled representation learning aims to uncover latent variables underlying the observed data, and generally speaking, rather strong assumptions are needed to ensure identifiability. Some approaches rely on sufficient changes on the distribution of latent variables indicated by auxiliary variables such as domain indices, but acquiring enough domains is often challenging. Alternative approaches exploit structural sparsity assumptions on the mixing procedure, but such constraints are usually (partially) violated in practice. Interestingly, we find that these two seemingly unrelated assumptions can actually complement each other to achieve identifiability. Specifically, when conditioned on auxiliary variables, the sparse mixing procedure assumption provides structural constraints on the mapping from estimated to true latent variables and hence compensates for potentially insufficient distribution changes. Building on this insight, we propose an identifiability theory with less restrictive constraints regarding distribution changes and the sparse mixing procedure, enhancing applicability to real-world scenarios. Additionally, we develop an estimation framework incorporating a domain encoding network and a sparse mixing constraint and provide two implementations based on variational autoencoders and generative adversarial networks, respectively. Experiment results on synthetic and real-world datasets support our theoretical results.

解耦表征稀疏混合可识别性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。