» Articles » PMID: 37687828

Research on 3D Reconstruction of Binocular Vision Based on Thermal Infrared

Overview
Journal Sensors (Basel)
Publisher MDPI
Specialty Biotechnology
Date 2023 Sep 9
PMID 37687828
Authors
Affiliations
Soon will be listed here.
Abstract

Thermal infrared imaging is less affected by lighting conditions and smoke compared to visible light imaging. However, thermal infrared images often have lower resolution and lack rich texture details, making them unsuitable for stereo matching and 3D reconstruction. To enhance the quality of infrared stereo imaging, we propose an advanced stereo matching algorithm. Firstly, the images undergo preprocessing using a non-local mean noise reduction algorithm to remove thermal noise and achieve a smoother result. Subsequently, we perform camera calibration using a custom-made chessboard calibration board and Zhang's camera calibration method to obtain accurate camera parameters. Finally, the disparity map is generated using the SGBM (semi-global block matching) algorithm based on the weighted least squares method, enabling the 3D point cloud reconstruction of the object. The experimental results demonstrate that the proposed algorithm performs well in objects with sufficient thermal contrast and relatively simple scenes. The proposed algorithm reduces the average error value by 10.9 mm and the absolute value of the average error by 1.07% when compared with the traditional SGBM algorithm, resulting in improved stereo matching accuracy for thermal infrared imaging. While ensuring accuracy, our proposed algorithm achieves the stereo reconstruction of the object with a good visual effect, thereby holding high practical value.

Citing Articles

Geometric Wide-Angle Camera Calibration: A Review and Comparative Study.

Huai J, Shao Y, Jozkow G, Wang B, Chen D, He Y Sensors (Basel). 2024; 24(20).

PMID: 39460076 PMC: 11510980. DOI: 10.3390/s24206595.


Iterative Network for Disparity Prediction with Infrared and Visible Light Images Based on Common Features.

Zhang Z, Li L, Jin W, Qu Z Sensors (Basel). 2024; 24(1).

PMID: 38203058 PMC: 10781222. DOI: 10.3390/s24010196.

References
1.
Eltuhamy R, Rady M, Almatrafi E, Mahmoud H, Ibrahim K . Fault Detection and Classification of CIGS Thin-Film PV Modules Using an Adaptive Neuro-Fuzzy Inference Scheme. Sensors (Basel). 2023; 23(3). PMC: 9921600. DOI: 10.3390/s23031280. View

2.
Zhou L, Gao S, Wang S, Zhang H, Liu R, Liu J . IPD-Net: Infrared Pedestrian Detection Network via Adaptive Feature Extraction and Coordinate Information Fusion. Sensors (Basel). 2022; 22(22). PMC: 9696594. DOI: 10.3390/s22228966. View

3.
Zhang J, Zhang Y, Wang C, Yu H, Qin C . Binocular stereo matching algorithm based on MST cost aggregation. Math Biosci Eng. 2021; 18(4):3215-3226. DOI: 10.3934/mbe.2021160. View

4.
Wang Y, Gu M, Zhu Y, Chen G, Xu Z, Guo Y . Improvement of AD-Census Algorithm Based on Stereo Vision. Sensors (Basel). 2022; 22(18). PMC: 9505044. DOI: 10.3390/s22186933. View

5.
Abreu de Souza M, Alka Cordeiro D, Oliveira J, Oliveira M, Bonafini B . 3D Multi-Modality Medical Imaging: Combining Anatomical and Infrared Thermal Images for 3D Reconstruction. Sensors (Basel). 2023; 23(3). PMC: 9919921. DOI: 10.3390/s23031610. View