| Paper ID | IVMSP-6.1 | ||
| Paper Title | DEEP LEARNING ARCHITECTURAL DESIGNS FOR SUPER-RESOLUTION OF NOISY IMAGES | ||
| Authors | Angel Villar-Corrales, Franziska Schirrmacher, Christian Riess, University of Erlangen-Nuremberg, Germany | ||
| Session | IVMSP-6: Super-resolution 2 & Multi-scale Processing | ||
| Location | Gather.Town | ||
| Session Time: | Tuesday, 08 June, 16:30 - 17:15 | ||
| Presentation Time: | Tuesday, 08 June, 16:30 - 17:15 | ||
| Presentation | Poster | ||
| Topic | Image, Video, and Multidimensional Signal Processing: [IVTEC] Image & Video Processing Techniques | ||
| IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
| Abstract | Recent advances in deep learning have led to significant improvements in single image super-resolution (SR) research. However, due to the amplification of noise during the upsampling steps, state-of-the-art methods often fail at reconstructing high-resolution images from noisy versions of their low-resolution counterparts. However, this is especially important for images from unknown cameras with unseen types of image degradation. In this work, we propose to jointly perform denoising and super-resolution. To this end, we investigate two architectural designs: “in-network” combines both tasks at feature level, while “pre-network” first performs denoising and then super-resolution. Our experiments show that both variants have specific advantages: The in-network design obtains the strongest results when the type of image corruption is aligned in the training and testing dataset, for any choice of denoiser. The pre-network design exhibits superior performance on unseen types of image corruption, which is a pathological failure case of existing super-resolution models. We hope that these findings help to enable super-resolution also in less constrained scenarios where source camera or imaging conditions are not well controlled. | ||