Dino Forcing Flow Models: Do not denoise what you can predict

GenAI Diffusion ML Generative Models DM
联合去噪预训练表征(例如DINO)可显著提升流匹配模型的训练速度与生成质量,但该方法引入了第二条去噪轨迹,且需精心设计针对表征的去噪调度策略。我们提出一种更简洁的替代方案:直接预测预训练表征,再将模型以自身对该表征的预测结果为条件进行建模。这一方法无需引入第二条常微分方程(ODE)路径,也无需为特定表征设计专门的去噪调度,同时仍能充分保留表征引导所带来的全部优势。实验表明,我们的方法收敛速度大幅提升,且在FID(Fréchet Inception Distance)指标上展现出更优的生成质量。在ImageNet数据集上,该方法在隐空间中仅需先前方法一半的训练轮数(2×更少的epoch),即已超越当前最先进的隐空间生成方法;在像素空间中,其FID指标相较同类已有方法提升了超过20%。这些结果印证了一个简洁而有力的原则:凡可直接预测者,无需再去噪。我们的代码已开源,地址为:https://github.com/arijit-hub/dino_forcing。
Co-denoising pretrained representations such as DINO can substantially improve the training speed and quality of flow matching models, but it introduces a second denoising trajectory and requires carefully designed schedules. We propose a simpler alternative: predict the pretrained representation directly, then condition the model on its own prediction. This removes the need for a second ODE and any representation-specific denoising schedules, while retaining the benefits of representation guidance. Our approach converges substantially faster and achieves better generation quality as measured by FID score. On ImageNet, it outperforms the state of the art in latent space at 2x fewer epochs than prior methods; in pixel space, it improves FID over comparable prior methods by more than 20%. These results support a simple principle: do not denoise what you can predict. Our code is openly available at https://github.com/arijit-hub/dino_forcing.
许愿