提出探索性建模,实现生成模型端到端训练并提升效率与性能。
Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation

- 通过探索候选匹配优化训练过程,让模型聚焦数据模式而非模糊混合。
- 探索性建模在图像、视频、语言任务中均提升性能,效率最高提升6.2倍。
- 适合追求高效生成和端到端训练的科研与工程人员使用。
深度学习革命始于AlexNet,证明端到端训练优于分阶段设计。然而生成建模仍为例外——尽管生成模型能力强大,却仍未实现端到端训练。原因在于生成建模需处理多模态分布,现有可扩展方法均通过分解生成过程来应对,阻碍了端到端实现。本文提出探索性建模(Explorative Modeling, XM),改从训练循环入手,探索K个模型生成与数据的候选匹配,仅对最佳匹配进行训练,使预测锁定具体模式而非模糊融合。实验表明,该方法在两类场景中均有效:第一,在现有生成模型中引入探索性作为继参数与数据后的第三预训练维度,增加探索能单调提升性能,涵盖连续与离散领域(图像、视频、语言);探索增益随规模上升,数据量增大时性能提升从7%升至36%,模型扩大时从13%增至23%,计算效率提升超两倍,FLOP效率提高4.1倍,样本效率提升6.2倍,参数效率提升47%;在无引导条件下,最强图像生成方案达ImageNet上1.43 FID,接近当前最优水平,并实现生成模型的可扩展泛化。第二,XM支持端到端重建式生成,控制任务性能媲美扩散模型,推理步骤减少16-256倍。综上,探索性建模既是现有生成模型的新预训练维度,也是一种独立的端到端生成范式。
原文摘要 · Abstract (English)
The deep learning revolution, kicked off by AlexNet, taught us that end-to-end training beats decomposing a problem into hand-designed stages. Generative modeling, however, has remained the exception-despite generative models being remarkably capable, they are still not trained end-to-end. This is because, at its core, generative modeling is about handling distributions with many modes, and existing scalable approaches handle this the same way, by factoring the generation procedure, which prevents end-to-end generation. In this work, we introduce Explorative Modeling, a new paradigm that instead factors the training loop, exploring K candidate matches between model generations and data, and training on the best, so predictions commit to modes rather than blurring them. We find Explorative Models (XMs) useful in two settings. First, increasing exploration adds a third pretraining axis beyond parameters and data for existing generative models-where scaling exploration monotonically improves performance across both continuous and discrete domains (images, video, and language). Notably, gains from exploration increase with scale, climbing from 7% to 36% as data scales and from 13% to 23% as models grow, with efficiency gains more than doubling at 3x the compute. Concretely, exploration improves FLOP efficiency by 4.1x, sample efficiency by 6.2x, parameter efficiency by 47%, lifts the strongest of image-generation recipes to a near-state-of-the-art 1.43 FID on ImageNet without guidance, enables scaling how end-to-end existing models are, and unlocks scaling generalization. Second, XMs enable end-to-end reconstructive generative modeling, matching diffusion on control tasks with 16-256x fewer inference steps. Together, these results establish XMs as both a new pretraining axis for existing generative models and a standalone end-to-end generative modeling paradigm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。