根据网络带宽动态调整图像生成质量,节省算力并提升视觉效果。
BADiff: Bandwidth Adaptive Diffusion Model
- 基于可用带宽动态调节去噪过程,实现自适应生成。
- 相比直接提前停止,生成图像感知质量显著提升。
- 轻量级改造,适合云到设备的低带宽场景应用。
本文提出一种新框架,使扩散模型能根据实时网络带宽动态调整生成质量。传统扩散模型在生成时执行固定数量的去噪步骤,无视传输限制。但在云到设备场景中,有限带宽常导致图像需重度压缩,丢失细节且浪费计算。为此,我们引入联合端到端训练策略,将扩散模型条件化于由带宽决定的目标质量等级。训练中,模型学会自适应调制去噪过程,支持按需提前停止采样,在保持适配传输条件的感知质量的同时减少计算开销。方法仅需最小架构改动,并采用轻量级质量嵌入引导去噪轨迹。实验表明,相比简单提前停止,本方法显著提升带宽适应生成的视觉保真度,为受限带宽环境下的高效图像传输提供可行方案。代码已开源:https://github.com/xzhang9308/BADiff。
原文摘要 · Abstract (English)
In this work, we propose a novel framework to enable diffusion models to adapt their generation quality based on real-time network bandwidth constraints. Traditional diffusion models produce high-fidelity images by performing a fixed number of denoising steps, regardless of downstream transmission limitations. However, in practical cloud-to-device scenarios, limited bandwidth often necessitates heavy compression, leading to loss of fine textures and wasted computation. To address this, we introduce a joint end-to-end training strategy where the diffusion model is conditioned on a target quality level derived from the available bandwidth. During training, the model learns to adaptively modulate the denoising process, enabling early-stop sampling that maintains perceptual quality appropriate to the target transmission condition. Our method requires minimal architectural changes and leverages a lightweight quality embedding to guide the denoising trajectory. Experimental results demonstrate that our approach significantly improves the visual fidelity of bandwidth-adapted generations compared to naive early-stopping, offering a promising solution for efficient image delivery in bandwidth-constrained environments. Code is available at: https://github.com/xzhang9308/BADiff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。