arXiv:2602.09983cs.CVcs.AI2026-02被引 2

用扩散模型联合推理实现语义成分分解,性能优于传统方法。

Coupled Inference in Diffusion Models for Semantic Decomposition

  • 将语义分解建模为逆问题,通过重建引导耦合扩散过程。
  • 在合成任务上显著超越共振网络,提升成分还原准确率。
  • 适用于需要解耦视觉要素的生成与编辑场景。

许多视觉场景可描述为潜在因子的组合。有效识别、推理与编辑往往不仅需要构建此类组合表示,还需解决分解问题。一种常用方法是通过绑定操作构建表示。共振网络(可理解为耦合霍普菲尔德网络)被提出用于对这类绑定表示进行分解。近期研究发现霍普菲尔德网络与扩散模型存在显著相似性。受此启发,本文提出基于扩散模型中耦合推理的语义分解框架。该方法将语义分解视为逆问题,利用重建驱动的引导项耦合扩散过程,促使因子估计的组合匹配原始绑定向量。此外,我们设计了一种新型迭代采样方案,提升了模型性能。最后,我们证明基于注意力的共振网络是本框架的特例。实验表明,该耦合推理框架在多种合成语义分解任务中均优于共振网络。

原文摘要 · Abstract (English)

Many visual scenes can be described as compositions of latent factors. Effective recognition, reasoning, and editing often require not only forming such compositional representations, but also solving the decomposition problem. One popular choice for constructing these representations is through the binding operation. Resonator networks, which can be understood as coupled Hopfield networks, were proposed as a way to perform decomposition on such bound representations. Recent works have shown notable similarities between Hopfield networks and diffusion models. Motivated by these observations, we introduce a framework for semantic decomposition using coupled inference in diffusion models. Our method frames semantic decomposition as an inverse problem and couples the diffusion processes using a reconstruction-driven guidance term that encourages the composition of factor estimates to match the bound vector. We also introduce a novel iterative sampling scheme that improves the performance of our model. Finally, we show that attention-based resonator networks are a special case of our framework. Empirically, we demonstrate that our coupled inference framework outperforms resonator networks across a range of synthetic semantic decomposition tasks.

扩散模型语义分解耦合推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。