arXiv:2511.21028eess.IVcs.CV2025-11被引 1

通过参数插值让神经网络接收标量输入,提升生成模型质量与效率。

Deep Parameter Interpolation for Scalar Conditioning

  • 在单个网络中维护两组可学习参数,用标量动态插值切换
  • 在扩散与流匹配模型中均提升去噪效果和生成样本质量
  • 无需修改架构,适合各类生成模型快速添加标量控制

我们提出深度参数插值(DPI),一种通用方法,可将现有深度神经网络架构改造为接受额外标量输入。近期的深度生成模型(包括扩散模型和流匹配)使用单一神经网络学习随时间或噪声水平变化的向量场。准确表示该向量场极具挑战性,因网络需融合高维向量(通常为图像)与标量信息。现有方法通常将标量编码为额外图像输入,或在特定组件中组合两者,限制了架构设计。我们提出在单个网络内保持两组可学习参数,并在训练与采样时根据标量值动态插值这两组参数以引入标量依赖。DPI是一种简单、与架构无关的方法,能为神经网络增加标量依赖。实验表明,该方法在扩散模型与流匹配模型中均提升了去噪性能与样本质量,且计算效率与标准标量条件技术相当。代码已公开于 https://github.com/wustl-cig/parameter_interpolation。

原文摘要 · Abstract (English)

We propose deep parameter interpolation (DPI), a general-purpose method for transforming an existing deep neural network architecture into one that accepts an additional scalar input. Recent deep generative models, including diffusion models and flow matching, employ a single neural network to learn a time- or noise level-dependent vector field. Designing a network architecture to accurately represent this vector field is challenging because the network must integrate information from two different sources: a high-dimensional vector (usually an image) and a scalar. Common approaches either encode the scalar as an additional image input or combine scalar and vector information in specific network components, which restricts architecture choices. Instead, we propose to maintain two learnable parameter sets within a single network and to introduce the scalar dependency by dynamically interpolating between the parameter sets based on the scalar value during training and sampling. DPI is a simple, architecture-agnostic method for adding scalar dependence to a neural network. We demonstrate that our method improves denoising performance and enhances sample quality for both diffusion and flow matching models, while achieving computational efficiency comparable to standard scalar conditioning techniques. Code is available at https://github.com/wustl-cig/parameter_interpolation.

生成模型参数插值扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。