arXiv:2510.04533cs.CV2025-10中稿 · ICML

不改模型结构,用轨迹信号修正生成方向,减少幻觉。

TAG: Tangential Amplifying Guidance for Hallucination-Resistant Sampling

  • 基于采样轨迹的切向分量放大,无需额外训练
  • 在多个数据集上提升图像一致性,且计算开销极小
  • 适合希望快速改进现有扩散模型的开发者

扩散模型虽能生成高质量图像,但常出现语义不一致或幻觉。现有推理阶段引导方法依赖外部信号或修改模型结构,带来额外计算开销。我们提出训练自由、架构无关、即插即用的切向放大引导(TAG),仅利用采样轨迹信号。TAG以中间样本为投影基准,放大估计梯度的切向分量,修正采样路径。一阶泰勒分析表明,该操作使状态趋向数据流形的高概率区域,有效降低不一致性并提升保真度,同时对现有采样器增加可忽略的计算负担。代码已开源。

原文摘要 · Abstract (English)

Diffusion models achieve state-of-the-art image generation but often produce semantic inconsistencies, or hallucinations. Existing inference-time guidance methods rely on external signals or architectural modifications, adding computational overhead. We propose $\mathbf{T}$angential $\mathbf{A}$mplifying $\mathbf{G}$uidance $\mathbf{(TAG)}$, a training-free, architecture-agnostic, plug-and-play guidance method that operates purely on trajectory signals. TAG uses an intermediate sample as a projection basis and amplifies the tangential components of the estimated score to correct the sampling trajectory. A first-order Taylor analysis shows that this steers the state toward higher-probability regions of the data manifold, reducing inconsistencies and improving fidelity while adding negligible overhead to existing samplers. Code is available at our Project Page (https://hyeon-cho.github.io/TAG/).

扩散模型生成质量幻觉抑制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。