论文标题

端到端的可区分学习,用于多曝光图像HDR图像合成

End-to-End Differentiable Learning to HDR Image Synthesis for Multi-exposure Images

论文作者

Kim, Jung Hee, Lee, Siyeong, Kang, Suk-Ju

论文摘要

最近,基于从给定的单一曝光的多重曝光堆栈的高动态范围(HDR)图像重建利用深度学习框架来生成高质量的HDR图像。这些常规网络专注于曝光转移任务,以重建多曝光堆栈。因此,由于发生反转伪影时,它们通常无法将多曝光堆栈融合到感知上令人愉悦的HDR图像中。我们通过提出一个具有完全可区分的高动态范围成像(HDRI)过程的新框架来解决基于堆栈重建方法的问题。通过明确使用损失,将网络的输出与地面真相HDR图像进行比较,我们的框架使一个神经网络可以为HDRI生成多重曝光堆栈,从而使HDRI稳定训练。换句话说,我们可区分的HDR合成层有助于深度神经网络训练以创建多曝光堆栈,同时反映HDRI过程中多曝光图像之间的精确相关性。此外,我们的网络使用图像分解和递归过程来促进曝光转移任务并适应响应递归频率。实验结果表明,在暴露转移任务和整个HDRI过程方面,所提出的网络的表现优于最先进的定量和定性结果。

Recently, high dynamic range (HDR) image reconstruction based on the multiple exposure stack from a given single exposure utilizes a deep learning framework to generate high-quality HDR images. These conventional networks focus on the exposure transfer task to reconstruct the multi-exposure stack. Therefore, they often fail to fuse the multi-exposure stack into a perceptually pleasant HDR image as the inversion artifacts occur. We tackle the problem in stack reconstruction-based methods by proposing a novel framework with a fully differentiable high dynamic range imaging (HDRI) process. By explicitly using the loss, which compares the network's output with the ground truth HDR image, our framework enables a neural network that generates the multiple exposure stack for HDRI to train stably. In other words, our differentiable HDR synthesis layer helps the deep neural network to train to create multi-exposure stacks while reflecting the precise correlations between multi-exposure images in the HDRI process. In addition, our network uses the image decomposition and the recursive process to facilitate the exposure transfer task and to adaptively respond to recursion frequency. The experimental results show that the proposed network outperforms the state-of-the-art quantitative and qualitative results in terms of both the exposure transfer tasks and the whole HDRI process.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源