arXiv:2606.28226cs.CVcs.AI2026-06被引 7

利用暴露偏差自身信号实现自修正,提升生成模型稳定性。

Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching

论文配图:Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching
图 1 · 摘自论文原文
  • 通过模拟单步推理过程识别偏差,利用方向与频率自适应反馈进行修正。
  • 在CIFAR-10、CelebA-64等数据集上显著优于基线,且推理鲁棒性强。
  • 适合关注生成模型稳定性与自调节机制的研究者或工程落地应用。

流匹配(Flow Matching, FM)虽生成性能优异,但因训练与推理阶段差异存在暴露偏差问题。现有方法多依赖静态约束或外部启发式策略。本文提出暴露偏差本身蕴含动态信号,可引导其自我修正。为此,我们设计DEFAR(DirEctional-Frequency Adaptive Rectification)框架:通过训练时模拟单步推理识别偏差;引入反漂移修正(ADR),将推理偏移视为方向信号,使模型具备主动纠正能力;提出频率补偿(FC),发现高噪声阶段常缺低频成分,而暴露偏差恰好携带缺失频率信息,以偏差自身作为反馈权重强化低频成分。在CIFAR-10、CelebA-64、ImageNet-256/512上的实验表明,DEFAR超越已有基线,展现良好可扩展性、兼容性及推理鲁棒性。

原文摘要 · Abstract (English)

Flow Matching (FM) has achieved remarkable generative performance, yet it suffers from exposure bias due to discrepancies between training and inference. Existing mitigation strategies typically rely on static constraints or external heuristics. In this work, we propose that exposure bias itself inherently contains dynamic signals that can guide its own rectification. To leverage this, we introduce DEFAR (DirEctional-Frequency Adaptive Rectification). This framework simulates the single-step inference process during training to identify exposure bias. It utilizes directional and frequency-adaptive feedback signals from the bias itself to enhance the model's bias tolerance. It consists of two key components: (1) Anti-Drift Rectification (ADR). ADR treats inference-time drift as a signal to learn the direction to steer deviated states back toward the target. ADR endows the model with intrinsic active self-rectification capabilities; (2) Frequency Compensation (FC). Empirically, we observe that accumulated bias often stems from a lack of low-frequency components in high-noise stages, and exposure bias carries the missing frequency. FC leverages the bias itself as a self-feedback weighting factor to reinforce the missing frequency components. Experiments on CIFAR-10, CelebA-64, and ImageNet-256/512 show that DEFAR outperforms prior baselines and further demonstrates favorable scalability, compatibility, and inference robustness.

生成模型流匹配自修正偏差缓解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。