让生成模型重复运行不跑偏,靠对齐编码解码几何结构
Encoder-Decoder Manifold Alignment for Idempotent Generation

- 通过对齐编码器与解码器的潜在流形几何结构,实现真正恒等映射
- 实验显示,重复生成时输出误差显著降低,结果更稳定一致
- 适合需要高保真图像生成与可控编辑的应用场景
近期多种学习范式被提出以在生成模型中强制实现恒等性,目标是确保当样本位于目标数据流形上时,重复应用模型不会改变其内容。然而,许多现有方法无法达到精确不动点,导致重复应用时出现不稳定和漂移。本文指出,根本原因在于编码器与解码器所学流形之间存在几何不匹配:编码器将输入投影到一个潜在流形,而解码器则隐式地从另一个不同的流形重建数据。这种差异阻碍了模型学习真正的恒等映射。为此,我们提出一种新训练框架,显式对齐编码器与解码器对同一基础数据流形的一致表示。通过统一两者的几何结构,该方法促进稳定投影。实验证明,相比现有方法,本方法显著降低恒等性误差,并在重复应用下始终生成相同输出。我们在图像生成与图像编辑任务上验证了该框架的有效性。进一步表明,以这种方式强制恒等性可提升身份保持与信息稳定性,使生成编辑模型更真实、更可控。
原文摘要 · Abstract (English)
Recently, several learning paradigms have been introduced to enforce idempotency in generative models. The goal is to ensure that repeated application of a model leaves samples unchanged once they lie on the target data manifold. In practice, however, many of these approaches fail to achieve exact fixed points, leading to instability and drift under repeated application. In this work, we argue that a key reason for this failure is a geometric mismatch between the manifolds learned by the encoder and decoder. The encoder projects inputs onto one latent manifold, while the decoder implicitly learns to reconstruct data from a different manifold. This discrepancy prevents the model from learning truly idempotent mappings. To address this issue, we propose a new training framework that explicitly closes this gap by forcing the encoder and decoder to learn consistent representations of the same underlying data manifold. By aligning the geometry of these components, our method encourages stable projections. Empirically, we show that our approach achieves significantly lower idempotency error and consistently regenerates identical outputs under repeated application, compared to existing methods. We demonstrate the effectiveness of the proposed framework on both image generation and image editing tasks. Finally, we show that enforcing idempotency in this manner improves identity preservation and information stability, leading to more realistic and controllable generative editing models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。