Spectral Reflectance Recovery from the Quadcolor Camera Signals Using the Interpolation and Weighted Principal Component Analysis Methods

Overview

Journal Sensors (Basel)

Publisher MDPI

Specialty Biotechnology

Date 2022 Aug 26

PMID 36016049

Authors

Yu-Che Wen

Senfar Wen

Long Hsu

Sien Chi

Affiliations

Soon will be listed here.

Abstract

The recovery of surface spectral reflectance using the quadcolor camera was numerically studied. Assume that the RGB channels of the quadcolor camera are the same as the Nikon D5100 tricolor camera. The spectral sensitivity of the fourth signal channel was tailored using a color filter. Munsell color chips were used as reflective surfaces. When the interpolation method or the weighted principal component analysis (wPCA) method is used to reconstruct spectra, using the quadcolor camera can effectively reduce the mean spectral error of the test samples compared to using the tricolor camera. Except for computation time, the interpolation method outperforms the wPCA method in spectrum reconstruction. A long-pass optical filter can be applied to the fourth channel for reducing the mean spectral error. A short-pass optical filter can be applied to the fourth channel for reducing the mean color difference, but the mean spectral error will be larger. Due to the small color difference, the quadcolor camera using an optimized short-pass filter may be suitable as an imaging colorimeter. It was found that an empirical design rule to keep the color difference small is to reduce the error in fitting the color-matching functions using the camera spectral sensitivity functions.

Citing Articles

Irradiance Independent Spectrum Reconstruction from Camera Signals Using the Interpolation Method.

Wen Y, Wen S, Hsu L, Chi S Sensors (Basel). 2022; 22(21).

PMID: 36366197 PMC: 9656597. DOI: 10.3390/s22218498.

References

Hu N, Li W, Du C, Zhang Z, Gao Y, Sun Z . Predicting micronutrients of wheat using hyperspectral imaging. Food Chem. 2020; 343:128473. DOI: 10.1016/j.foodchem.2020.128473. View

Xie Y, Liu C, Liu S, Song W, Fan X . Snapshot Imaging Spectrometer Based on Pixel-Level Filter Array (PFA). Sensors (Basel). 2021; 21(7). PMC: 8037454. DOI: 10.3390/s21072289. View

Weksler S, Rozenstein O, Haish N, Moshelion M, Wallach R, Ben-Dor E . Detection of Potassium Deficiency and Momentary Transpiration Rate Estimation at Early Growth Stages Using Proximal Hyperspectral Imaging and Extreme Gradient Boosting. Sensors (Basel). 2021; 21(3). PMC: 7867110. DOI: 10.3390/s21030958. View

Wen Y, Wen S, Hsu L, Chi S . Auxiliary Reference Samples for Extrapolating Spectral Reflectance from Camera RGB Signals. Sensors (Basel). 2022; 22(13). PMC: 9269503. DOI: 10.3390/s22134923. View

Gholizadeh H, Gamon J, Helzer C, Cavender-Bares J . Multi-temporal assessment of grassland α- and β-diversity using hyperspectral imaging. Ecol Appl. 2020; 30(7):e02145. DOI: 10.1002/eap.2145. View

Darrodi M, Finlayson G, Goodman T, Mackiewicz M . Reference data set for camera spectral sensitivity estimation. J Opt Soc Am A Opt Image Sci Vis. 2015; 32(3):381-91. DOI: 10.1364/JOSAA.32.000381. View

Ortega S, Halicek M, Fabelo H, Callico G, Fei B . Hyperspectral and multispectral imaging in digital and computational pathology: a systematic review [Invited]. Biomed Opt Express. 2020; 11(6):3195-3233. PMC: 7315999. DOI: 10.1364/BOE.386338. View

Zhang Y, Xi Y, Yang Q, Cong W, Zhou J, Wang G . Spectral CT Reconstruction with Image Sparsity and Spectral Mean. IEEE Trans Comput Imaging. 2017; 2(4):510-523. PMC: 5637560. DOI: 10.1109/TCI.2016.2609414. View

Moghareh Abed F, Amirshahi S, Abed M . Reconstruction of reflectance data using an interpolation technique. J Opt Soc Am A Opt Image Sci Vis. 2009; 26(3):613-24. DOI: 10.1364/josaa.26.000613. View

10.

Lv M, Chen T, Yang Y, Tu T, Zhang N, Li W . Membranous nephropathy classification using microscopic hyperspectral imaging and tensor patch-based discriminative linear regression. Biomed Opt Express. 2021; 12(5):2968-2978. PMC: 8194628. DOI: 10.1364/BOE.421345. View

11.

Finlayson G, Darrodi M, Mackiewicz M . Rank-based camera spectral sensitivity estimation. J Opt Soc Am A Opt Image Sci Vis. 2016; 33(4):589-99. DOI: 10.1364/JOSAA.33.000589. View

12.

Finlayson G, Mackiewicz M, Hurlbert A . Color correction using root-polynomial regression. IEEE Trans Image Process. 2015; 24(5):1460-70. DOI: 10.1109/TIP.2015.2405336. View

13.

Cai F, Lu W, Shi W, He S . A mobile device-based imaging spectrometer for environmental monitoring by attaching a lightweight small module to a commercial digital camera. Sci Rep. 2017; 7(1):15602. PMC: 5688121. DOI: 10.1038/s41598-017-15848-x. View

14.

Gomes V, Mendes-Ferreira A, Melo-Pinto P . Application of Hyperspectral Imaging and Deep Learning for Robust Prediction of Sugar and pH Levels in Wine Grape Berries. Sensors (Basel). 2021; 21(10). PMC: 8156429. DOI: 10.3390/s21103459. View

15.

Tominaga S, Nishi S, Ohtera R, Sakai H . Improved method for spectral reflectance estimation and application to mobile phone cameras. J Opt Soc Am A Opt Image Sci Vis. 2022; 39(3):494-508. DOI: 10.1364/JOSAA.449347. View

16.

Courtenay L, Gonzalez-Aguilera D, Laguela S, Del Pozo S, Ruiz-Mendez C, Barbero-Garcia I . Hyperspectral imaging and robust statistics in non-melanoma skin cancer analysis. Biomed Opt Express. 2021; 12(8):5107-5127. PMC: 8407807. DOI: 10.1364/BOE.428143. View

17.

Xu P, Xu H, Diao C, Ye Z . Self-training-based spectral image reconstruction for art paintings with multispectral imaging. Appl Opt. 2017; 56(30):8461-8470. DOI: 10.1364/AO.56.008461. View

18.

Picollo M, Cucci C, Casini A, Stefani L . Hyper-Spectral Imaging Technique in the Cultural Heritage Field: New Possible Scenarios. Sensors (Basel). 2020; 20(10). PMC: 7287632. DOI: 10.3390/s20102843. View

19.

Ji Y, Kwak Y, Park S, Kim Y . Compressive recovery of smartphone RGB spectral sensitivity functions. Opt Express. 2021; 29(8):11947-11961. PMC: 8237928. DOI: 10.1364/OE.420069. View

20.

Maloney L . Evaluation of linear models of surface spectral reflectance with small numbers of parameters. J Opt Soc Am A. 1986; 3(10):1673-83. DOI: 10.1364/josaa.3.001673. View