arXiv:2606.20404cs.CV2026-06

让生成模型学会自我纠错,提升条件一致性。

FlowBender: Feedback-Aware Training for Self-Correcting Conditional Flows

论文配图:FlowBender: Feedback-Aware Training for Self-Correcting Conditional Flows
图 1 · 摘自论文原文
  • 引入闭环反馈机制,用自身误差指导修正
  • 在图像翻译等任务中同时提升精度与自然度
  • 适用于可微与不可微的约束场景,计算开销低

条件扩散与流模型常无法满足其任务定义的约束。例如,深度条件模型生成的图像重提取深度往往与输入不一致,尽管前向算子(深度预测器)在训练和推理时都可用。现有方法分为两类:将条件信号视为静态提示的监督模型,忽略推理时的对齐信息;以及通过手工调参线性更新的引导方法,通常在条件保真度与样本合理性之间权衡。我们指出两种范式的核心缺陷在于:模型从未被训练利用自身对齐误差。为此提出 FlowBender,一个将误差作为首类输入的闭环框架,训练网络学习基于推理时反馈的修正策略。每步执行无引导预览以估计干净信号,通过前向算子计算特定任务偏差,再经修正步骤结合该信号生成校正速度。我们提出多种变体,包括针对可微算子的梯度形式与适用于非可微场景(如JPEG压缩)的零阶版本。为高效采样,引入先验步捷径,实现闭环修正且额外计算成本极小。在图像到图像转换、修复与3D网格纹理任务中,FlowBender持续优于标准监督基线、对齐损失增强训练及最先进的推理时引导方法,实现精度与合理性同步提升而非相互妥协。

原文摘要 · Abstract (English)

Conditional diffusion and flow models routinely fail to satisfy the very constraints that define their task. For instance, a depth-conditioned model often produces images whose re-extracted depth disagrees with the input, even though the forward operator--the depth predictor defining the constraint--is available during both training and inference. Existing approaches generally fall into two categories: supervised models that treat the conditioning signal as a static cue and ignore alignment information at inference, and guidance-based methods that consult it through hand-tuned linear updates, typically trading fidelity to the condition against the plausibility of the generated sample. We argue that the fundamental gap in both paradigms is that the model is never trained to utilize its own alignment error. We introduce FlowBender, a closed-loop framework that treats this error as a first-class input, training the network to learn a correction policy conditioned on inference-time feedback. At each step, an unguided look-ahead pass estimates the clean signal, a task-specific deviation is computed via the forward operator, and a refinement pass consumes this signal to produce a corrected velocity. We propose several variants of FlowBender, including a gradient-based formulation for differentiable operators and a zero-order variant for non-differentiable settings such as JPEG compression. For efficient sampling, we introduce a prior-step shortcut that enables closed-loop correction at a minimal additional computational cost. Across image-to-image translation, restoration, and 3D mesh texturing, FlowBender consistently outperforms standard supervised baselines, alignment-loss-augmented training, and state-of-the-art inference-time guidance, improving fidelity and plausibility simultaneously rather than trading them against each other. Project page: https://flow-bender.github.io/

生成模型自我纠错条件生成闭环控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。