From SRA to Self-Flow: Data Augmentation or Self-Supervision?

AK's Picks GenAI Diffusion SCCE ML SSLRO LFDDR
2026年07月02日
表征对齐已成为加速扩散Transformer训练并提升生成质量的一种有效方法。近期提出的自对齐方法(例如SRA与Self-Flow)进一步摆脱了对外部预训练编码器的依赖,转而在扩散模型内部构建对齐机制。然而,从SRA到Self-Flow所引入的“双时间步调度”(dual-time scheduling)这一改进机制,其内在原理迄今尚未得到充分探究:Self-Flow将性能提升归因于不同噪声水平下token之间的交互作用——即更“干净”的token有助于推断更“嘈杂”的token。本文重新审视这一解释,并提出疑问:该提升效果是否实际上源于沿噪声维度所实现的数据增强?为厘清上述两种因素的贡献,我们提出了“注意力分离”(Attention Separation)方法:该方法在保持与Self-Flow完全相同的双时间步输入的前提下,阻断被分配至不同噪声水平的token之间的注意力连接。令人意外的是,移除此类跨噪声水平的token交互非但未导致性能下降,反而有时还能带来进一步提升,这表明SRA到Self-Flow的性能增益主要源自数据增强效应。此外,我们进一步证明,“注意力分离”本身即具备数据增强作用——它将单张图像拆分为多个有效的训练片段,从而实质性地扩充了训练数据规模。基于上述发现,我们将自表征对齐、双时间步调度与注意力分离式数据增强三者有机结合,并在ImageNet数据集上验证了该设计的有效性。
Representation alignment has become an effective way to accelerate diffusion transformer training and improve generation quality. Recent self-alignment methods, such as SRA and Self-Flow, further remove the dependency on external pretrained encoders by constructing alignment within the diffusion model itself. However, the mechanism behind the improvement from SRA to Self-Flow, dual-time scheduling, remains under-examined: Self-Flow attributes its gain to interactions between tokens at different noise levels, where cleaner tokens help infer noisier ones. In this work, we revisit this explanation and ask whether the gain instead comes from data augmentation along the noise dimension. To disentangle these factors, we introduce Attention Separation, which preserves the same dual-timestep input as Self-Flow while blocking attention between tokens assigned to different noise levels. Surprisingly, removing such interaction does not degrade performance and can even improve it, suggesting that the improvement from SRA to Self-Flow mainly comes from data augmentation. Furthermore,We show that Attention Separation itself provides an augmentation effect by splitting a single image into multiple effective training parts to expand the training data. Based on these observations, we combine self-representation alignment with dual-timestep and attention-separation augmentation, and demonstrate the effectiveness of this design on ImageNet.
许愿