arXiv:2602.16498cs.LGcs.AI2026-02

提出新方法让生成模型快71倍,还能在ImageNet上跑起来。

Fast and Scalable Analytical Diffusion

  • 用动态筛选关键数据子集替代全量扫描,降低计算开销。
  • 在AFHQ上实现71倍加速,且性能不降反升。
  • 首次实现分析式生成模型在ImageNet上的成功应用。

分析式扩散模型通过贝叶斯后验均值形式化去噪得分,具备数学可解释性,但其标准实现需在每个时间步扫描整个数据集,复杂度随数据规模线性增长。本文首次系统研究该可扩展性瓶颈,发现随着信噪比提升,去噪得分的有效支持集会从全局流形逐渐收缩至局部邻域,称为后验渐进集中现象。基于此,提出无需训练的动态时间感知黄金子集扩散(GoldDiff),采用粗到精机制动态定位推理所需的'黄金子集'。理论上,推导出严格边界保证稀疏近似收敛于精确得分;实验上,GoldDiff在AFHQ上实现71倍加速,性能优于或等同于全扫描基线。更重要的是,首次成功将分析式扩散扩展至ImageNet-1K,开启大规模、免训练生成建模的新范式。

原文摘要 · Abstract (English)

Analytical diffusion models offer a mathematically transparent path to generative modeling by formulating the denoising score as an empirical-Bayes posterior mean. However, this interpretability comes at a prohibitive cost: the standard formulation necessitates a full-dataset scan at every timestep, scaling linearly with dataset size. In this work, we present the first systematic study addressing this scalability bottleneck. We challenge the prevailing assumption that the entire training data is necessary, uncovering the phenomenon of Posterior Progressive Concentration: the effective golden support of the denoising score is not static but shrinks asymptotically from the global manifold to a local neighborhood as the signal-to-noise ratio increases. Capitalizing on this, we propose Dynamic Time-Aware Golden Subset Diffusion (GoldDiff), a training-free framework that decouples inference complexity from dataset size. Instead of static retrieval, GoldDiff uses a coarse-to-fine mechanism to dynamically pinpoint the ''Golden Subset'' for inference. Theoretically, we derive rigorous bounds guaranteeing that our sparse approximation converges to the exact score. Empirically, GoldDiff achieves a $\bf 71 \times$ speedup on AFHQ while matching or achieving even better performance than full-scan baselines. Most notably, we demonstrate the first successful scaling of analytical diffusion to ImageNet-1K, unlocking a scalable, training-free paradigm for large-scale generative modeling.

扩散模型生成模型高效推理可扩展性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。