arXiv:2507.02619cs.LGcs.CV2025-07被引 5

让自动编码器自动学习权重,更好分离图像特征。

L-VAE: Variational Auto-Encoder with Learnable Beta for Disentangled Representation

  • 自动调节损失函数权重,动态平衡重建与解耦效果。
  • 在dSprites等4个数据集上表现最优或第二优。
  • 适合需要高质量特征解耦的图像生成与分析任务。

本文提出一种新型模型L-VAE,可同时学习解耦表示与损失函数的超参数。L-VAE是β-VAE的扩展,通过学习损失项的相对权重,动态调整解耦与重建之间的平衡。模型在训练中同步优化损失权重与网络参数,并引入额外正则项,避免偏向重建或解耦。实验表明,L-VAE在dSprites、MPI3D-complex、Falcor3D和Isaac3D等多个数据集上,于多种解耦度量指标上均达到最佳或次佳表现。在CelebA数据集上的定性结果也验证了其对人脸属性的有效解耦能力。

原文摘要 · Abstract (English)

In this paper, we propose a novel model called Learnable VAE (L-VAE), which learns a disentangled representation together with the hyperparameters of the cost function. L-VAE can be considered as an extension of \b{eta}-VAE, wherein the hyperparameter, \b{eta}, is empirically adjusted. L-VAE mitigates the limitations of \b{eta}-VAE by learning the relative weights of the terms in the loss function to control the dynamic trade-off between disentanglement and reconstruction losses. In the proposed model, the weight of the loss terms and the parameters of the model architecture are learned concurrently. An additional regularization term is added to the loss function to prevent bias towards either reconstruction or disentanglement losses. Experimental analyses show that the proposed L-VAE finds an effective balance between reconstruction fidelity and disentangling the latent dimensions. Comparisons of the proposed L-VAE against \b{eta}-VAE, VAE, ControlVAE, DynamicVAE, and σ-VAE on datasets, such as dSprites, MPI3D-complex, Falcor3D, and Isaac3D reveals that L-VAE consistently provides the best or the second best performances measured by a set of disentanglement metrics. Moreover, qualitative experiments on CelebA dataset, confirm the success of the L-VAE model for disentangling the facial attributes.

自编码器特征解耦无监督学习生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。