Provable diffusion-based posterior sampling for linear inverse problems via DDIM

GenAI Diffusion ML BAY INF CV SR and Denoising
2026年07月21日
基于扩散的方法在求解反问题方面已取得显著的经验性成功。然而,目前许多后验采样器要么缺乏严格的理论保证,要么带来巨大的计算开销。为此,我们提出了一种简单高效的算法——称为PDDIM——利用DDIM类采样器,结合扩散先验来求解线性反问题。该方法仅需对标准DDIM更新进行轻量级、逐坐标(coordinate-wise)的修改,同时显式地融入观测模型。其核心思想是:沿测量算子各奇异方向分别进行后验采样;对于每个方向,当观测信噪比(SNR)低于对应扩散过程的SNR时,采样器遵循所学习到的扩散先验;否则,则切换为经校准的、基于测量的预测器。我们严格证明了所提出的采样器能够收敛至以观测数据为条件的贝叶斯后验分布。实验结果表明,在一系列图像复原任务中,该采样器相较现有各类基于扩散的后验采样方法均展现出优越性能,并在绝大多数评估指标上取得了最优结果。总体而言,我们的工作将含噪声线性反问题的后验采样转化为一系列简单的逐坐标DDIM更新,从而得到一种高效、易于实现且具备可证明后验一致性的算法。
Diffusion-based methods have achieved remarkable empirical success in solving inverse problems. However, many existing posterior samplers either lack rigorous theoretical guarantees or incur substantial computational overhead. We propose a simple and efficient algorithm, called \pddim, for solving linear inverse problems with diffusion priors via a DDIM-type sampler. Our method requires only lightweight, coordinate-wise modifications to the standard DDIM update, while explicitly incorporating the measurement model. The key idea is to perform posterior sampling separately along each singular direction of the measurement operator: for each direction, the sampler follows the learned diffusion prior when the observation signal-to-noise ratio (SNR) is below the corresponding diffusion SNR, and switches to a calibrated measurement-based predictor otherwise. We prove that the proposed sampler converges to the Bayesian posterior conditioned on the measurements. Empirical results show that the proposed sampler performs favorably against existing diffusion-based posterior samplers across a range of image restoration tasks, achieving the best performance on the majority of evaluation metrics considered. Overall, our results convert posterior sampling for noisy linear inverse problems to simple coordinate-wise DDIM updates, yielding an efficient, easy-to-implement algorithm with provable posterior consistency.
许愿