用可微分图像测量构建可控、可比、可组合的连续调节器。
Measured Sliders: Learning Continuous Controls from Differentiable Image Measurements

- 基于图像空间的可微分测量定义控制轴,统一训练流程。
- 光照方向控制相关性达0.995,98.9%单调变化,五属性控制选择性提升至2.59。
- 无需联合训练即可组合多个LoRA分支,适合需要精准调控的生成应用。
连续滑块的有效性依赖于系数变化能带来可预测的图像变化。然而,多数扩散模型滑块基于文本或学习表征定义轴向,其尺度与可观测图像属性脱节。这导致无法预先判断哪些属性可调控、无法直接比较控制强度,也无法预测多控制叠加时的干扰。我们提出Measured Sliders框架,通过闭式可微分图像测量定义连续控制。统一的测量空间贯穿整个流程:训练前,可观测性测试识别有效监督信号;训练中,测量引导目标实现的同时抑制非目标变化;训练后,解码校准将控制转化为可比的图像变化单位。多个LoRA分支可存于单一检查点中,无需联合激活训练即可组合。在SDXL和FLUX.1-dev上,控制结果有序、选择性强、可组合。在553个提示下,光照方向相关性达rho = 0.995,98.9%为单调变化;五属性检查点平均选择性2.59,优于最强基线(1.50);96.7%的双属性组合、86.1%的三属性组合均保留所有请求方向。可观测性测试也成功区分了后续成功的测量与失败候选。图像空间测量为学习、诊断、校准与组合生成控制提供了统一基础。
原文摘要 · Abstract (English)
Continuous sliders are useful only when coefficient changes produce predictable image changes. Yet most diffusion sliders derive their axes from text or learned representations, leaving their scales disconnected from observable image properties. Consequently, we cannot tell in advance which attributes are learnable, compare control strengths directly, or anticipate interference when multiple controls are combined. We propose Measured Sliders, a framework that defines continuous controls through closed-form differentiable image measurements. A common measurement space unifies the pipeline. Before training, an observability test identifies usable supervision. During training, a measurement-guided objective learns target movement while suppressing non-target changes. After training, decoded calibration expresses controls in comparable units of realized image change. Multiple LoRA branches are stored in one checkpoint and composed without training on joint activations. Across SDXL and FLUX.1-dev, the resulting controls are ordered, selective, and composable. On 553 prompts, lighting direction reaches rho = 0.995 and 98.9% monotone sweeps. A five-attribute checkpoint achieves average selectivity 2.59, compared with 1.50 for the strongest baseline, and preserves every requested direction in 96.7% of pair and 86.1% of triple compositions. The observability test also separates every subsequently successful measurement from the failed candidate. Overall, image-space measurement provides a common basis for learning, diagnosing, calibrating, and composing continuous generative controls.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。