arXiv:2606.06477cs.CV2026-06

按难易程度分配生成能力,让模型更高效地生成高质量数据。

Complexity-Balanced Diffusion Splitting

  • 将生成过程分段,复杂区域用更强子网络应对。
  • 在SiT-XL上提升35%的生成质量(FID)。
  • 无需调参或复杂计算,适合各类生成模型使用。

标准连续时间生成模型采用统一架构处理从纯噪声到复杂数据分布的全过程,但全时域使用大模型效率低下。本文提出复杂度平衡分割(CBS),基于函数逼近理论与de Boor等分布原则,将扩散时间线划分为近似负担均等的段落,将更多容量分配给建模难度高的区域。通过引入两个可计算的监测函数——基于流的Dirichlet能量的空间度量和基于采样轨迹加速度的几何度量——结合轻量辅助模型估算局部复杂度,避免启发式分段或昂贵搜索。在SiT、JiT和UNet等多种架构及多个数据集上的实验证明,CBS在不增加每步推理成本的前提下,持续提升生成质量。尤其在SiT-XL上,相较朴素时间分割,FID提升约35%。项目主页见https://noamissachar.github.io/CBS/。

原文摘要 · Abstract (English)

Standard continuous-time generative models rely on monolithic architectures that must navigate vastly different signal regimes, from isotropic noise to intricate data distributions. While scaling model capacity improves performance, deploying a massive network uniformly across the entire generative timeline is inherently inefficient. In this work, we propose Complexity-Balanced Splitting (CBS), a principled framework for temporal capacity allocation that distributes the generative workload across multiple specialized sub-networks. Grounded in function approximation theory and de Boor's equidistribution principle, CBS partitions the diffusion timeline into segments of equal approximation burden, allocating more representational capacity to regions where the generative dynamics are more difficult to model. To estimate this local complexity, we introduce two complementary and tractable monitor functions: a spatial measure based on the flow's Dirichlet energy, and a geometric measure based on the acceleration of the sampling trajectories. Using a lightweight auxiliary model to estimate these complexity profiles, our approach eliminates the need for heuristic temporal splits or computationally expensive search procedures. Extensive evaluation across multiple architectures (SiT, JiT, and UNet) and datasets demonstrates that CBS consistently improves synthesis quality without increasing per-step inference cost. In particular, CBS improves FID by ~35% on SiT-XL with CFG relative to naive temporal partitioning. Project page is available at https://noamissachar.github.io/CBS/.

扩散模型生成模型效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。