Sharp-NeRF: Grid-based Fast Deblurring Neural Radiance Fields Using Sharpness Prior

2024年01月01日
Neural Radiance Fields(NeRF)在基于神经渲染的新视角合成方面表现出了卓越的性能。然而,当输入图像在捕获时存在不完美的条件,如光照不足、焦点模糊和镜头畸变时,NeRF会遭受严重的视觉质量下降。尤其是焦点模糊在使用相机正常捕获图像时非常普遍。虽然最近有几项研究提出了渲染相当高质量的清晰图像的方法,但它们仍面临许多关键挑战。特别是,这些方法使用了基于多层感知器(MLP)的NeRF,需要巨大的计算时间。为了克服这些缺点,本文提出了一种新的技术Sharp-NeRF——一种基于网格的NeRF,可以在半小时内从输入的模糊图像中渲染出干净、清晰的图像。为此,我们使用了几个基于网格的核来精确地模拟场景的清晰度/模糊度。像素的清晰度水平被计算出来,以学习空间变化的模糊核。我们在由模糊图像组成的基准测试上进行了实验,并评估了全参考和非参考指标。定性和定量结果表明,我们的方法可以呈现出鲜艳的颜色和精细的细节,训练时间比之前的方法要快得多。我们的项目页面可在https://benhenryl.github.io/SharpNeRF/上找到。
Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect conditions, such as poor illumination, defocus blurring, and lens aberrations. Especially, defocus blur is quite common in the images when they are normally captured using cameras. Although few recent studies have proposed to render sharp images of considerably high-quality, yet they still face many key challenges. In particular, those methods have employed a Multi-Layer Perceptron (MLP) based NeRF, which requires tremendous computational time. To overcome these shortcomings, this paper proposes a novel technique Sharp-NeRF -- a grid-based NeRF that renders clean and sharp images from the input blurry images within half an hour of training. To do so, we used several grid-based kernels to accurately model the sharpness/blurriness of the scene. The sharpness level of the pixels is computed to learn the spatially varying blur kernels. We have conducted experiments on the benchmarks consisting of blurry images and have evaluated full-reference and non-reference metrics. The qualitative and quantitative results have revealed that our approach renders the sharp novel views with vivid colors and fine details, and it has considerably faster training time than the previous works. Our project page is available at https://benhenryl.github.io/SharpNeRF/
许愿