arXiv:2603.13450cs.CVcs.CL2026-03ACL被引 1

通过动态修复图像生成前沿,实现高效文生图。

LADR: Locality-Aware Dynamic Rescue for Efficient Text-to-Image Generation with Diffusion Large Language Models

  • 基于图像局部性与马尔可夫特性,优先恢复生成前沿像素。
  • 实测推理速度提升约4倍,生成质量不降反升。
  • 无需训练,适合对效率敏感的文生图场景。

离散扩散语言模型已成为统一多模态生成的有力范式,但其部署受限于迭代解码带来的高推理延迟。现有加速策略常需昂贵重训练,或无法利用视觉数据固有的二维空间冗余。为此,我们提出无训练的局域感知动态救援(LADR)方法,通过利用图像的空间马尔可夫特性加速推理。LADR 优先恢复位于“生成前沿”的像素——即与已观测像素相邻的区域,以最大化信息增益。具体而言,该方法结合形态学邻域识别定位候选像素,采用风险约束过滤机制防止错误传播,并利用流形一致的逆调度策略使扩散轨迹与加速掩码密度对齐。在四个文生图基准上的实验表明,相比标准基线,LADR 实现约4倍的速度提升。尤为关键的是,生成保真度不仅得以保持,甚至在空间推理任务中有所增强,实现了效率与质量的顶尖平衡。

原文摘要 · Abstract (English)

Discrete Diffusion Language Models have emerged as a compelling paradigm for unified multimodal generation, yet their deployment is hindered by high inference latency arising from iterative decoding. Existing acceleration strategies often require expensive re-training or fail to leverage the 2D spatial redundancy inherent in visual data. To address this, we propose Locality-Aware Dynamic Rescue (LADR), a training-free method that expedites inference by exploiting the spatial Markov property of images. LADR prioritizes the recovery of tokens at the ''generation frontier'', regions spatially adjacent to observed pixels, thereby maximizing information gain. Specifically, our method integrates morphological neighbor identification to locate candidate tokens, employs a risk-bounded filtering mechanism to prevent error propagation, and utilizes manifold-consistent inverse scheduling to align the diffusion trajectory with the accelerated mask density. Extensive experiments on four text-to-image generation benchmarks demonstrate that our LADR achieves an approximate 4 x speedup over standard baselines. Remarkably, it maintains or even enhances generative fidelity, particularly in spatial reasoning tasks, offering a state-of-the-art trade-off between efficiency and quality.

文生图扩散模型加速推理空间冗余

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。