arXiv:2607.02508cs.CV2026-07

发现自对齐提升主要来自噪声维度的数据增强,而非跨噪声层级的注意力交互。

From SRA to Self-Flow: Data Augmentation or Self-Supervision?

论文配图:From SRA to Self-Flow: Data Augmentation or Self-Supervision?
图 1 · 摘自论文原文
  • 引入注意力分离机制,隔离不同噪声层级的注意力,验证其影响
  • 实验显示移除跨噪声交互后性能不降反升,证明增强效应为主因
  • 提出结合双时间步与注意力分离的新型数据增强策略,适用于图像生成

表示对齐已成为加速扩散变压器训练并提升生成质量的有效方法。近期自对齐方法如SRA和Self-Flow进一步摆脱对外部预训练编码器的依赖,通过在扩散模型内部构建对齐关系实现。然而,从SRA到Self-Flow的性能提升机制——双时间调度——仍缺乏深入分析:Self-Flow认为其增益源于不同噪声水平下token之间的交互,较清晰的token有助于推断较嘈杂的token。本文重新审视这一解释,质疑其增益是否实际上来自沿噪声维度的数据增强。为解耦这些因素,我们引入注意力分离(Attention Separation),在保持Self-Flow相同双时间步输入的前提下,阻断不同噪声层级间token的注意力。令人意外的是,移除此类交互并未导致性能下降,甚至有所提升,表明从SRA到Self-Flow的改进主要源自数据增强。此外,我们发现注意力分离本身即具有增强效果,通过将单张图像拆分为多个有效训练片段以扩展训练数据。基于此观察,我们将自表示对齐与双时间步及注意力分离增强相结合,在ImageNet上验证了该设计的有效性。

原文摘要 · Abstract (English)

Representation alignment has become an effective way to accelerate diffusion transformer training and improve generation quality. Recent self-alignment methods, such as SRA and Self-Flow, further remove the dependency on external pretrained encoders by constructing alignment within the diffusion model itself. However, the mechanism behind the improvement from SRA to Self-Flow, dual-time scheduling, remains under-examined: Self-Flow attributes its gain to interactions between tokens at different noise levels, where cleaner tokens help infer noisier ones. In this work, we revisit this explanation and ask whether the gain instead comes from data augmentation along the noise dimension. To disentangle these factors, we introduce Attention Separation, which preserves the same dual-timestep input as Self-Flow while blocking attention between tokens assigned to different noise levels. Surprisingly, removing such interaction does not degrade performance and can even improve it, suggesting that the improvement from SRA to Self-Flow mainly comes from data augmentation. Furthermore,We show that Attention Separation itself provides an augmentation effect by splitting a single image into multiple effective training parts to expand the training data. Based on these observations, we combine self-representation alignment with dual-timestep and attention-separation augmentation, and demonstrate the effectiveness of this design on ImageNet.

扩散模型自监督数据增强图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。