arXiv:2603.25463cs.CV2026-03

通过区间协作解码,让图像生成更快更省资源。

CIAR: Interval-based Collaborative Decoding for Image Generation Acceleration

  • 用连续区间量化令牌不确定性,替代传统离散验证。
  • 加速2.18倍,云请求减少70%,图像质量不变。
  • 适合移动端部署,尤其对高分辨率图像生成有效。

自回归(AR)模型在图像生成上已接近扩散模型性能,但其计算密集和串行特性阻碍了设备端部署,导致延迟显著。本文提出云-端协同框架CIAR,利用设备端自验证机制应对视觉合成的两大特性:高保真图像所需的大词汇量和同质区域中的固有空间冗余(高度可预测),而物体边界则具有高不确定性。均匀验证会浪费资源于冗余令牌。解决方案核心是设备端的令牌不确定性量化器,采用连续概率区间加速处理,支持大规模视觉词汇表,而非传统离散解集。同时引入区间增强解码模块,通过分布对齐训练策略,在保持视觉保真度和语义一致性的同时进一步提速。大量实验表明,CIAR相比现有方法实现2.18倍加速,云请求减少70%,且图像质量无损。

原文摘要 · Abstract (English)

Auto-regressive (AR) models have recently made notable progress in image generation, achieving performance comparable to diffusion-based approaches. However, their computational intensity and sequential nature impede on-device deployment, causing disruptive latency. We address this via a cloud-device collaboration framework \textbf{CIAR}, which utilizes on-device self-verification to handle two key properties of visual synthesis: \textit{the vast token vocabulary} required for high-fidelity images and \textit{inherent spatial redundancy} which leads to extreme predictability in homogeneous regions, while object boundaries exhibit high uncertainty. Uniform verification wastes resources on such redundant tokens. Our solution centers on an on-device token uncertainty quantifier, which adopts continuous probability intervals to accelerate processing and make it feasible for large visual vocabularies instead of conventional discrete solution sets. Additionally, we incorporate a Interval-enhanced decoding module to further speed up decoding while maintaining visual fidelity and semantic consistency via a distribution alignment training strategy. Extensive experiments demonstrate that CIAR achieves a 2.18x speed-up and reduces cloud requests by 70\%, while preserving image quality compared to existing methods.

图像生成加速推理云边协同自回归模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。