arXiv:2510.21402cs.LGcs.CV2025-10NeurIPS被引 3

通过模块化混合策略实现属性与物体的解耦表征,无需改模型或目标函数。

Disentangled Representation Learning via Modular Compositional Bias

  • 按因子特性随机重组潜在变量,设计专属混合规则。
  • 在多种组合下保持生成图像真实性和潜空间一致性,效果优于基线。
  • 支持属性、物体及两者联合解耦,适合复杂场景建模任务。

现有解耦表征学习方法依赖特定于属性或物体的学习目标或模型结构来引入归纳偏置,但当新变因不满足既定假设(如统计独立性或空间互斥性)或多个因素共存时,需重设计架构或目标,开销大。为此,我们提出一种模块化组合偏置,其与目标和架构解耦。核心思想是:不同因素在数据分布中遵循不同的重组规则——全局属性互斥(如一张脸只有一个鼻子),而物体共享公共支撑(任意子集可共存)。因此,我们根据因子特异性规则随机混合适当潜在变量(即混合策略),并通过两个互补目标迫使编码器发现该策略所反映的因子结构:(i) 先验损失确保每种重混后都能解码出真实图像;(ii) Wiedemer 等人(arXiv:2310.05327)提出的组合一致性损失,使合成图像与其对应合成潜在变量对齐。在此通用框架下,仅调整混合策略即可实现属性、物体乃至两者的联合解耦,无需修改目标或架构。大量实验表明,本方法在属性与物体解耦上表现优异,并唯一实现了全局风格与物体的联合解耦。代码已公开于 https://github.com/whieya/Compositional-DRL。

原文摘要 · Abstract (English)

Recent disentangled representation learning (DRL) methods heavily rely on factor specific strategies-either learning objectives for attributes or model architectures for objects-to embed inductive biases. Such divergent approaches result in significant overhead when novel factors of variation do not align with prior assumptions, such as statistical independence or spatial exclusivity, or when multiple factors coexist, as practitioners must redesign architectures or objectives. To address this, we propose a compositional bias, a modular inductive bias decoupled from both objectives and architectures. Our key insight is that different factors obey distinct recombination rules in the data distribution: global attributes are mutually exclusive, e.g., a face has one nose, while objects share a common support (any subset of objects can co-exist). We therefore randomly remix latents according to factor-specific rules, i.e., a mixing strategy, and force the encoder to discover whichever factor structure the mixing strategy reflects through two complementary objectives: (i) a prior loss that ensures every remix decodes into a realistic image, and (ii) the compositional consistency loss introduced by Wiedemer et al. (arXiv:2310.05327), which aligns each composite image with its corresponding composite latent. Under this general framework, simply adjusting the mixing strategy enables disentanglement of attributes, objects, and even both, without modifying the objectives or architectures. Extensive experiments demonstrate that our method shows competitive performance in both attribute and object disentanglement, and uniquely achieves joint disentanglement of global style and objects. Code is available at https://github.com/whieya/Compositional-DRL.

解耦表征组合偏置生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。