Cited time in webofscience Cited time in scopus

CMSNet: Deep Color and Monochrome Stereo

CMSNet: Deep Color and Monochrome Stereo
Jeon, Hae-GonIm, SunghoonChoe, JaesungKang, MinjunLee, Joon-YoungHebert, Martial
DGIST Authors
Jeon, Hae-GonIm, SunghoonChoe, JaesungKang, MinjunLee, Joon-YoungHebert, Martial
Issued Date
Author Keywords
Stereo matchingDisparity estimationImage enhancementConvolutional neural network
In this paper, we propose an end-to-end convolutional neural network for stereo matching with color and monochrome cameras, called CMSNet (Color and Monochrome Stereo Network). Both cameras have the same structure except for the presence of a Bayer filter, but have a fundamental trade-off. The Bayer filter allows capturing chrominance information of scenes, but limits a quantum efficiency of cameras, which causes severe image noise. It seems ideal if we can take advantage of both the cameras so that we obtain noise-free images with their corresponding disparity maps. However, image luminance recorded from a color camera is not consistent with that from a monochrome camera due to spatially-varying illumination and different spectral sensitivities of the cameras. This degrades the performance of stereo matching. To solve this problem, we design CMSNet for disparity estimation from noisy color and relatively clean monochrome images. CMSNet also infers a noise-free image with the estimated disparity map. We leverage a data augmentation to simulate realistic signal-dependent noise and various radiometric distortions between input stereo pairs to train CMSNet effectively. CMSNet is evaluated using various datasets and the performance of our disparity estimation and image enhancement consistently outperforms state-of-the-art methods. © 2022, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
Kluwer Academic Publishers
Related Researcher
  • 임성훈 Im, Sunghoon 전기전자컴퓨터공학과
  • Research Interests Computer Vision; Deep Learning; Robot Vision
Files in This Item:

There are no files associated with this item.

Appears in Collections:
Department of Electrical Engineering and Computer Science Computer Vision Lab. 1. Journal Articles


  • twitter
  • facebook
  • mendeley

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.