Simplified Diffusion Schrödinger Bridge

2024年03月21日
本文介绍了一种新的理论简化Diffusion Schr\"odinger Bridge(DSB)的方法,使其能够与基于Score的生成模型(SGM)统一,解决了DSB在复杂数据生成方面的局限性,并实现了更快的收敛和更好的性能。通过使用SGM作为DSB的初始解决方案,我们的方法利用了两种框架的优点,确保了更高效的训练过程,并提高了SGM的性能。我们还提出了一种重新参数化技术,尽管存在理论上的近似,但实际上提高了网络的拟合能力。我们进行了广泛的实验评估,证实了简化的DSB的有效性,并展示了其显著的改进。我们相信这项工作的贡献为先进的生成建模铺平了道路。代码可在https://github.com/tzco/Simplified-Diffusion-Schrodinger-Bridge上获得。
This paper introduces a novel theoretical simplification of the Diffusion Schr\"odinger Bridge (DSB) that facilitates its unification with Score-based Generative Models (SGMs), addressing the limitations of DSB in complex data generation and enabling faster convergence and enhanced performance. By employing SGMs as an initial solution for DSB, our approach capitalizes on the strengths of both frameworks, ensuring a more efficient training process and improving the performance of SGM. We also propose a reparameterization technique that, despite theoretical approximations, practically improves the network's fitting capabilities. Our extensive experimental evaluations confirm the effectiveness of the simplified DSB, demonstrating its significant improvements. We believe the contributions of this work pave the way for advanced generative modeling. The code is available at https://github.com/tzco/Simplified-Diffusion-Schrodinger-Bridge.