提出新方法分离内容与风格,即使二者相关也能准确识别。
Content-Style Identification via Differential Independence
- 通过内容与风格的微小变化在数据流形上正交来实现分离。
- 在高维图像生成中验证了方法可识别内容与风格变量。
- 适合需要解耦生成或反事实数据构建的研究者使用。
生成建模常将多域观测建模为域不变内容变量与域特定风格变量的非线性混合。从无配对域中同时识别两者可支持域迁移和反事实数据生成。以往工作依赖内容与风格的(分块)统计独立性,或对非线性混合函数的稀疏雅可比假设,但这些条件在实际中较受限。本文提出内容-风格微分独立性(CSDI),要求内容与风格的无穷小变化在数据流形上诱导正交方向,从而在内容与风格相关且雅可比密集时仍能保证可识别性。我们通过内容与风格相关雅可比子空间的分块正交约束实现该条件。为支持高维生成模型,设计基于数值雅可比近似的随机正则化项,实现高分辨率图像生成等场景下的可扩展训练。多个数据集上的实验验证了可识别性分析,并展示了在反事实生成与域翻译任务中的实际优势。
原文摘要 · Abstract (English)
Generative analysis often models multi-domain observations as nonlinear mixtures of domain-invariant content variables and domain-specific style variables. Identifying both factors from unpaired domains enables tasks such as domain transfer and counterfactual data generation. Prior work establishes identifiability under (block-wise) statistical independence between content and style, or via sparse Jacobian assumptions on the nonlinear mixing function, but such conditions can be restrictive in practice. In this work, we introduce content-style differential independence (CSDI), an alternative structural condition requiring that infinitesimal variations in content and style induce orthogonal directions on the data manifold, thereby enabling identifiability even when content and style are dependent and the Jacobian is dense. We operationalize this condition through a blockwise orthogonality constraint on the Jacobian subspaces associated with content and style. To support high-dimensional generative models, we design a stochastic regularizer based on numerical Jacobian approximation, enabling scalable training in settings such as high-resolution image generation. Experiments across multiple datasets corroborate the identifiability analysis and demonstrate practical benefits on counterfactual generation and domain translation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。