根据图像生成过程动态调整引导强度,提升编辑与生成质量。
VAGS: Velocity Adaptive Guidance Scale for Image Editing and Generation

- 通过速度场相似性自适应调节引导尺度,无需训练或额外计算。
- 在多个数据集上显著提升结构保真度和生成质量,优于固定引导方法。
- 适用于无反演编辑与图像生成,适合追求高质量输出的研究者。
分类器自由引导(CFG)是控制文本语义对基于流的采样器影响强度的主要手段,但传统做法在整个常微分方程(ODE)轨迹中保持引导尺度不变。这存在根本性不匹配:早期步骤以噪声为主,语义信号弱;晚期步骤确定图像结构,需更强方向性约束。更重要的是,引导强度的有效性取决于引导速度是否与模型当前动态一致。本文提出速度自适应引导尺度(VAGS),一种无需训练的替代方案,通过将名义引导尺度乘以一个结合时间信号水平与任务相关速度场余弦相似性的有界因子实现自适应调节。对于无反演编辑,VAGS测量源与目标引导速度之间的对齐度,使每一步的编辑强度反映局部保真与转换的兼容性;对于生成,VAGS-Gen使用无条件与条件速度场间的对齐度作为信号。两种变体均无需微调、辅助网络或额外前向传播,固定CFG可视为特例。在PIE-Bench和DIV2K上的编辑任务,以及COCO17、CUB-200和Flickr30K上的生成任务中,VAGS始终优于固定CFG及近期无训练引导方法,显著提升结构保真度与生成质量。代码已开源。
原文摘要 · Abstract (English)
Classifier-free guidance (CFG) is the primary control over how strongly text semantics move a flow-based sampler, yet standard practice holds its scale fixed across the entire ODE trajectory. This is a fundamental mismatch: early steps are noise-dominated and carry weak semantic signal, while late steps commit image structure and demand stronger directional commitment; more critically, the value of any guidance strength depends on whether the guided velocity is consistent with the model's current dynamics or working against them. We propose \textit{Velocity-Adaptive Guidance Scale} (VAGS), a training-free replacement that multiplies the nominal scale by a bounded factor combining a temporal signal-level term with the cosine similarity between task-relevant velocity fields. For inversion-free editing, VAGS measures the alignment between source- and target-guided velocities, so edit strength at each step reflects local compatibility between preservation and transformation. For generation, VAGS-Gen uses the alignment between unconditional and conditional velocities as the analogous signal. Neither variant requires fine-tuning, auxiliary networks, or extra forward passes, and fixed CFG is recovered as a special case. On PIE-Bench and DIV2K for editing, and COCO17, CUB-200, and Flickr30K for generation, VAGS consistently improves structural fidelity and generation quality over fixed CFG and recent training-free guidance variants. The code is publicly available at https://github.com/Harvard-AI-and-Robotics-Lab/Velocity_Adaptive_Guidance_Scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。