A plug-and-play demosaicing and denoising method on mobile cameras

Haoying Li; Honghao Chen; Meng Chang; Huajun Feng; Zhihai Xu; Qi Li; Yueting Chen

doi:10.1117/12.2606869

24 November 2021 A plug-and-play demosaicing and denoising method on mobile cameras

Haoying Li, Honghao Chen, Meng Chang, Huajun Feng, Zhihai Xu, Qi Li, Yueting Chen

Proceedings Volume 12065, AOPC 2021: Optical Sensing and Imaging Technology; 1206537 (2021) https://doi.org/10.1117/12.2606869
Event: Applied Optics and Photonics China 2021, 2021, Beijing, China

Abstract

Image demosaicing and denoising are two important processes in the ISP pipeline of mobile cameras, because almost all mobile cameras in use today require colorful images generated by demosaicing algorithm, and the small sensor area of mobile cameras triggers low signal-to-noise ratio. Over the years, a considerable number of sequential demosaicing and denoising methods have been proposed, while they suﬀer from estimating the noise distribution and adjusting the hyper-parameters in order to balance demosaicing and denoising. There exit simultaneous demosaicing and denoising methods solving these problems. But they lack guidelines designed for mobile cameras. We propose a Plug-and-Play (PnP) demosaicing and denoising method on mobile cameras. Our method is built on PnP demosaicing framework which is derived from variable splitting theory. Any color demosaicing algorithm (i.e., bilinear, Malvar) can be plugged into our framework. We novelly trained an ISO conditioned denoiser for the framework and iteratively apply the denoiser in it. The ISO conditioned denoiser not only removes noise from the demosaicing procedure itself but also noise from camera sensors. By introducing ISO settings to the denoiser, our method takes possession of the adaptability and robustness in various capturing environments under diﬀerent camera settings. Our method has only two hyperparameters to tune, which eases the hyper-parameter adjustment in sequential demosaicing and denoising methods. Extensive experiments on synthetic datasets show that our method performs better than sequential demosaicing and denoising methods and is practical for mobile cameras.

Citation Download Citation

Haoying Li, Honghao Chen, Meng Chang, Huajun Feng, Zhihai Xu, Qi Li, and Yueting Chen "A plug-and-play demosaicing and denoising method on mobile cameras", Proc. SPIE 12065, AOPC 2021: Optical Sensing and Imaging Technology, 1206537 (24 November 2021); https://doi.org/10.1117/12.2606869

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Denoising

Cameras

RGB color model

Sensors

Signal to noise ratio

Image processing

Image sensors

Show All Keywords

Keywords/Phrases

Search In:

Publication Years