arXiv:2605.06512cs.CV2026-05被引 1

让扩散模型生成罕见但合理的画面组合,避免被常见结果干扰。

DCR: Counterfactual Attractor Guidance for Rare Compositional Generation

论文配图:DCR: Counterfactual Attractor Guidance for Rare Compositional Generation
图 1 · 摘自论文原文
  • 用反事实吸引子抑制模型默认生成倾向。
  • 在不重训练的情况下提升罕见组合生成准确率。
  • 适合需要精准控制生成内容的创意设计场景。

扩散模型能生成逼真视觉内容,但在面对训练数据中稀少但合理的组合(如雪地海滩、夜间彩虹)时,常退化为更常见的替代方案。我们识别出这种失败模式为默认完成偏差,即去噪轨迹被高频语义配置隐式吸引。现有引导机制未显式建模此竞争倾向,因此难以阻止退化。我们提出无需训练的默认完成排斥(DCR)框架,通过放松罕见组合因素并保留周围语义构建反事实吸引子,诱导替代去噪轨迹以反映模型偏好。定义目标与吸引子轨迹间的差异为反事实漂移,并提出基于投影的排斥机制,移除与此漂移方向对齐的引导成分。该方法抑制了不必要的高频完成,同时保留其他语义。DCR完全运行于标准扩散采样流程中,无需重新训练或修改架构。在罕见组合提示下的实验表明,DCR提升了组合保真度,同时保持视觉质量。分析进一步显示,该框架揭示并对抗了模型内在偏见,为可控生成提供了超越显式约束的新视角。

原文摘要 · Abstract (English)

Diffusion models generate realistic visual content, yet often fail to produce rare but plausible compositions. When prompted with combinations that are valid but underrepresented in training data, such as a snowy beach or a rainbow at night, the generation process frequently collapses toward more common alternatives. We identify this failure mode as default completion bias, where denoising trajectories are implicitly attracted toward high-frequency semantic configurations. Existing guidance mechanisms do not explicitly model this competing tendency and therefore struggle to prevent such collapse. We introduce Default Completion Repulsion (DCR), a training-free framework that explicitly models and suppresses default completion behavior. DCR constructs a counterfactual attractor by relaxing the rare compositional factor while preserving surrounding semantics, inducing an alternative denoising trajectory reflecting the model's preferred completion. We define the discrepancy between target and attractor trajectories as a counterfactual drift, and propose a projection-based repulsion mechanism that removes guidance components aligned with this drift direction. This suppresses undesired frequent completions while preserving other semantic components. DCR operates entirely within the standard diffusion sampling process without retraining or architectural modification. Experiments on rare compositional prompts show that DCR improves compositional fidelity while maintaining visual quality. Our analysis further shows that the framework exposes and counteracts intrinsic model biases, offering a new perspective on controllable generation beyond explicit constraint enforcement.

扩散模型生成控制罕见组合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。