Open Access Open Access  Restricted Access Subscription or Fee Access

Single Sensor Camera Image Denoising Using PCA and Demosaicking with LMMSE

Arti Noor, Y.K. Jain, Ashok Saini

Abstract


Single sensor cameras are used mostly for image acquisition in digital cameras with a colour filter array (CFA). These cameras save image in an unrefined format, since the complete process of image acquisition get lengthy and complex, so it introduces noise in the image and hence requires some efficient technique for denoising. Different techniques have been used to denoise the captured image but efficiency of the algorithms has not been up to the mark because of various limitations. This paper introduces a method for denoising in which the 2D image component is decomposed in high-pass and low-pass component, high-pass component is then denoised using principal component analysis (PCA), and combined with the low-pass component which is then demosaicked and converted to RGB image format. Demosaicking is done through linear minimal mean square error (LMMSE) estimation process. The performance of the system can be estimated with the help of signal-to-noise ratio (SNR) analysis and visual quality.

Cite this Article
Noor A, Jain YK, Saini A. Single Sensor Camera Image Denoising Using PCA and Demosaicking with LMMSE. Journal of Image Processing & Pattern Recognition Progress. 2016; 3(2): 1–10p.


Keywords


colour filter array (CFA), principal component analysis (PCA), linear minimal mean square error (LMMSE), signal-to-noise (SNR) ratio, denoising

Full Text:

PDF

References


Zhang L, Lukac R, Wu X, et al. PCA-Based Spatially Adaptive Denoising of CFA Images for Single-Sensor Digital Cameras. IEEE Transactions on Image Processing. 2009; 18(4): 797–812p. DOI: 10.1109/TIP.2008.2011384.

Longère P, Zhang X, Delahunt PB, et al. Perceptual assessment of demosaicing algorithm performance. Proceedings of the IEEE. 2002; 90(1): 123–32p.

Adams JE. Intersections between color plane interpolation and other image processing functions in electronic photography. Proceedings of the SPIE. 1995; 2416: 144–51p.

Chang E, Cheung S, Pan DY. Color filter array recovery using a threshold-based variable number of gradients. Proceedings of the SPIE. 1999; 3650: 36–43p.

Gunturk BK, Glotzbach J, Altunbasak Y, et al. Demosaicking: Color filter array interpolation in single chip digital cameras. IEEE Signal Process Mag. 2005; 22(1): 44–54p.

Zhang L, Wu X. Color demosaicking via directional linear minimum mean square-error estimation. IEEE Trans Image Process. 2005; 14(12): 2167–78p.

Lukac R, Plataniotis KN. Color filter arrays: design and performance analysis. IEEE Trans Consum Electron. 2005; 51(11): 1260–7p.

Lukac R, Smolka B, Martin K, et al. Vector filtering for color imaging. IEEE Signal Process Mag. 2005; 22(1): 74–86p.

Lukac R, Martin K, Plataniotis KN. Demosaicked image post- processing using local color ratios. IEEE Trans Circuits Syst Video Technol. 2004; 14(6): 914–20p.

Muresan DD, Parks TW. Demosaicing using optimal recovery. IEEE Trans Image Process. 2005; 14(2): 267–78p.

Chang SG, Yu B, Vetterli M. Spatially adaptive wavelet thresholding with context modeling for image denoising. IEEE Trans Image Process. 2000; 9(9): 1522–31p.

Zhang L, Bao P, Wu X. Multiscale LMMSE-based image de-noising with optimal wavelet selection. IEEE Trans Circuits Syst Video Technol. 2005; 15(4): 469–81p.

Pizurica A, Philips W. Estimating the probability of the presence of a signal of interest in multiresolution single- and multiband image denoising. IEEE Trans Image Process. 2006; 15(3): 654–65p.

Portilla J, Strela V, Wainwright MJ, et al. Image denoising using scale mixtures of gaussians in the wavelet domain. IEEE Trans Image Process. 2003; 12(11): 1338–51p.

Muresan DD, Parks TW. Adaptive principal components and image denoising. Proceedings of the International Conference on Image Processing; 2003 Sep 14–17; Barcelona, Spain. I101–4p.

Hirakawa K, Parks TW. Joint demosaicking and denoising. IEEE Trans Image Process. 2006; 15(8): 2146–57p.

Hirakawa K, Meng XL, Wolfe PJ. A framework for wavelet- based analysis and processing of color filter array images with applications to denoising and demosaicing. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. 2007 Apr 15–20; Honolulu, HI. 1: I-597–I-600p.

Hirakawa K, Meng XL. An empirical bayes EM-wavelet unification for simultaneous denoising, interpolation, and/or demosaicing. Proceedings of the International Conference on Image Processing; 2006 Oct 8–11; Atlanta, GA. 1453–6p.

Zhang L, Wu X, Zhang D. Color reproduction from noisy CFA data of single sensor digital cameras. IEEE Trans Image Process. 2007; 16(9): 2184–97p.

Paliy D, Katkovnik V, Bilcu R, et al. Spatially adaptive color filter array interpolation for noiseless and noisy data. Int J Imaging Systems and Technology, Special Issue on Applied Color Image Processing. 2007; 17: 105–22p.

Paliy D, Trimeche M, Katkovnik V, et al. Demosaicing of noisy data: spatially adaptive approach. Proceedings of the SPIE. 2007; 6497: 64970K–64970K.

Foi A, Alenius S, Katkovnik V, et al. Noise measurement for raw-data of digital imaging sensors by automatic segmentation of nonuniform targets. IEEE Sensors J. 2007; 7: 1456–61p.

Foi A, Katkovnik V, Paliy D, et al. Apparatus, Method, Mobile Station and Computer Program Product for Noise Estimation, Modeling and Fil- tering of a Digital Image. U.S. Patent Application No. 11/426,128 USA: US Patents; 2006.

Cohen A, Daubechies I, Feauveau JC. Biorthogonal bases of compactly supported wavelets. Comm Pure Appl Math. 1992; 45: 485–560p.

Mallat S, Zhong S. Characterization of signals from multiscale edges. IEEE Trans Pattern Anal Machine Intell. 1992; 14(7): 710–32p.

Chang SG, Yu B, Vetterli M. Spatially adaptive wavelet thresholding with context modeling for image denoising. IEEE Trans Image Process. 2000; 9(9): 1522–31p.

Bao P, Zhang L. Noise reduction for magnetic resonance images via adaptive multiscale products thresholding. IEEE Trans Medical Imaging. 2003; 22(9): 1089–99p.

Zhang L, Bao P. Edge detection by scale multiplication in wavelet domain. Pattern Recognit Lett. 2002; 23: 1771–84p.

Li X, Orchard M. Spatially adaptive image denoising under over- complete expansion. Proceedings of the International Conference on Image Processing; 2000 Sep 10–13; Vancouver, Canada. 300–3p.

Hsiang ST. Embedded image coding using zeroblocks of sub- band/wavelet coefficients and context modeling. Proceedings of the 2000 IEEE International Symposium on Circuits and Systems; 2000 May 28–31; Geneva. 83–92p.

Fan G, Xia XG. Improved hidden Markov models in the wavelet- domain. IEEE Trans Signal Process. 2001; 49(1): 115–20p.

Fan G, Xia XG. Image denoising using local contextual hidden Markov model in the wavelet domain. IEEE Signal Process Lett. 2001; 8(5): 125–8p.

Liu J, Moulin P. Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients. IEEE Trans Image Process. 2001; 10(11): 1647–58p.


Refbacks

  • There are currently no refbacks.


This site has been shifted to https://stmcomputers.stmjournals.com/