arXiv:2607.09892eess.IVcs.AI2026-07

用密集步长预测实现高效多模态图像生成

Next-Dense-Stride Prediction for Multimodal Autoregressive Visual Modeling

论文配图:Next-Dense-Stride Prediction for Multimodal Autoregressive Visual Modeling
图 1 · 摘自论文原文
  • 通过逐步加密的步长遍历单尺度潜空间,实现从全局到细节的渐进生成
  • 在脑部MRI上统一完成跨模态转换、条件生成与肿瘤分割,性能媲美专用模型
  • 相比传统方法,推理更快且无需多尺度令牌,适合多任务通用建模

我们提出DenseAR,一种新的生成范式,将自回归图像生成重构为使用紧凑单尺度分词器的粗粒度到细粒度的下一批密集步长预测。核心思想是:以逐步加密的步长遍历单尺度潜在网格,自然捕捉从整体结构到精细细节的演变过程。该方法同时解决了现有自回归模型的两个局限:避免了栅格顺序自回归带来的缓慢推理(通过并行预测多个标记),以及多尺度方法所需的高昂成本(无需长的多分辨率标记序列即可实现粗到细预测)。基于这一高效框架和自回归建模的灵活性,我们进一步将DenseAR扩展为统一模型,可在单一主干网络中处理多种模态和成像任务。我们在医学和自然图像上验证了DenseAR的有效性。在多对比度脑部MRI数据集上,单个DenseAR模型统一实现了跨模态转换、模态条件生成和肿瘤分割,性能与专用方法相当。在ImageNet上,DenseAR在类别条件生成质量上优于无步长排序的单网格基线和基于多尺度分词器的基线(FID和IS指标提升)。

原文摘要 · Abstract (English)

We introduce DenseAR, a new generative paradigm that reformulates autoregressive image generation as coarse-to-fine next-dense-stride prediction using a compact single-scale tokenizer. Our key insight is that traversing a single-scale latent grid with progressively denser strides naturally captures the transition from global structure to fine detail. This addresses two limitations of existing autoregressive models at once: the slow inference of raster-order autoregression, which DenseAR avoids by predicting multiple tokens in parallel, and the heavy cost of multi-scale approaches, which need long, multi-resolution token sequences to achieve coarse-to-fine prediction. Building on our efficient framework and the flexibility of autoregressive modeling, we further extend DenseAR to a unified model that handles multiple modalities and imaging tasks within a single backbone. We validate DenseAR on both medical and natural images. On multi-contrast brain MRI, a single DenseAR model unifies cross-modal translation, modality-conditioned generation, and tumor segmentation, while remaining competitive with task-specific methods. On ImageNet, DenseAR improves class-conditional generation quality (FID and IS) over both a single-grid baseline without stride ordering and a multi-scale tokenizer-based baseline.

图像生成自回归模型多模态医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。