GTA-HDR: A Large-Scale Synthetic Dataset for HDR Image Reconstruction

CV SR and Denoising Other CV
2024年03月26日
高动态范围(HDR)内容(即图像和视频)具有广泛的应用。然而,从现实场景中捕获HDR内容是昂贵和耗时的。因此,从其低动态范围(LDR)对应物中重建视觉上准确的HDR图像的具有挑战性的任务正在引起视觉研究界的关注。这个研究问题的一个主要挑战是缺乏数据集,这些数据集捕捉了不同的场景条件(例如,照明,阴影,天气,位置,风景,物体,人类,建筑)和各种图像特征(例如,颜色,对比度,饱和度,色调,亮度,亮度,辐射度)。为了解决这个问题,在本文中,我们介绍了GTA-HDR,这是一个从GTA-V视频游戏中采样的大规模合成数据集,其中包含逼真的HDR图像。我们对所提出的数据集进行了彻底的评估,证明了与最先进的HDR图像重建方法相比,其在定性和定量上都有显著的改进。此外,我们展示了所提出的数据集的有效性及其对其他计算机视觉任务(包括3D人体姿态估计,人体部位分割和整体场景分割)的影响。数据集,数据收集管道和评估代码可在以下网址获得:https://github.com/HrishavBakulBarua/GTA-HDR。
High Dynamic Range (HDR) content (i.e., images and videos) has a broad range of applications. However, capturing HDR content from real-world scenes is expensive and time- consuming. Therefore, the challenging task of reconstructing visually accurate HDR images from their Low Dynamic Range (LDR) counterparts is gaining attention in the vision research community. A major challenge in this research problem is the lack of datasets, which capture diverse scene conditions (e.g., lighting, shadows, weather, locations, landscapes, objects, humans, buildings) and various image features (e.g., color, contrast, saturation, hue, luminance, brightness, radiance). To address this gap, in this paper, we introduce GTA-HDR, a large-scale synthetic dataset of photo-realistic HDR images sampled from the GTA-V video game. We perform thorough evaluation of the proposed dataset, which demonstrates significant qualitative and quantitative improvements of the state-of-the-art HDR image reconstruction methods. Furthermore, we demonstrate the effectiveness of the proposed dataset and its impact on additional computer vision tasks including 3D human pose estimation, human body part segmentation, and holistic scene segmentation. The dataset, data collection pipeline, and evaluation code are available at: https://github.com/HrishavBakulBarua/GTA-HDR.
许愿