Passive Polarized Vision for Autonomous Vehicles: A Review

Overview

Journal Sensors (Basel)

Publisher MDPI

Specialty Biotechnology

Date 2024 Jun 19

PMID 38894104

Authors

Julien R Serres

Pierre-Jean Lapray

Stephane Viollet

Thomas Kronland-Martinet

Antoine Moutenet

Olivier Morel

Laurent Bigue

Affiliations

Soon will be listed here.

Abstract

This review article aims to address common research questions in passive polarized vision for robotics. What kind of polarization sensing can we embed into robots? Can we find our geolocation and true north heading by detecting light scattering from the sky as animals do? How should polarization images be related to the physical properties of reflecting surfaces in the context of scene understanding? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying future directions in passive polarized vision for robotics. After an introduction, three key interconnected areas will be covered in the following sections: embedded polarization imaging; polarized vision for robotics navigation; and polarized vision for scene understanding. We will then discuss how polarized vision, a type of vision commonly used in the animal kingdom, should be implemented in robotics; this type of vision has not yet been exploited in robotics service. Passive polarized vision could be a supplemental perceptive modality of localization techniques to complement and reinforce more conventional ones.

References

Dabov K, Foi A, Katkovnik V, Egiazarian K . Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans Image Process. 2007; 16(8):2080-95. DOI: 10.1109/tip.2007.901238. View

Pierangelo A, Nazac A, Benali A, Validire P, Cohen H, Novikova T . Polarimetric imaging of uterine cervix: a case study. Opt Express. 2013; 21(12):14120-30. DOI: 10.1364/OE.21.014120. View

Daly I, How M, Partridge J, Temple S, Marshall N, Cronin T . Dynamic polarization vision in mantis shrimps. Nat Commun. 2016; 7:12140. PMC: 4945877. DOI: 10.1038/ncomms12140. View

Yang G, Bellingham J, Dupont P, Fischer P, Floridi L, Full R . The grand challenges of . Sci Robot. 2020; 3(14). DOI: 10.1126/scirobotics.aar7650. View

Kreuter A, Zangerl M, Schwarzmann M, Blumthaler M . All-sky imaging: a simple, versatile system for atmospheric research. Appl Opt. 2013; 48(6):1091-7. DOI: 10.1364/ao.48.001091. View

Tyo J . Design of optimal polarimeters: maximization of signal-to-noise ratio and minimization of systematic error. Appl Opt. 2002; 41(4):619-30. DOI: 10.1364/ao.41.000619. View

Guo X, Chu J, Wang Y, Wan Z, Li J, Lin M . Formation experiment with heading angle reference using sky polarization pattern at twilight. Appl Opt. 2019; 58(34):9331-9337. DOI: 10.1364/AO.58.009331. View

Pan S, Lin J, Zhang Y, Hu B, Liu X, Yu Q . Image-registration-based solar meridian detection for accurate and robust polarization navigation. Opt Express. 2024; 32(2):1357-1370. DOI: 10.1364/OE.510283. View

Sakura M, Lambrinos D, Labhart T . Polarized skylight navigation in insects: model and electrophysiology of e-vector coding by neurons in the central complex. J Neurophysiol. 2007; 99(2):667-82. DOI: 10.1152/jn.00784.2007. View

10.

Cronin T, Marshall J . Patterns and properties of polarized light in air and water. Philos Trans R Soc Lond B Biol Sci. 2011; 366(1565):619-26. PMC: 3049010. DOI: 10.1098/rstb.2010.0201. View

11.

Takacs P, Szaz D, Pereszlenyi A, Horvath G . Speedy bearings to slacked steering: Mapping the navigation patterns and motions of Viking voyages. PLoS One. 2023; 18(11):e0293816. PMC: 10664959. DOI: 10.1371/journal.pone.0293816. View

12.

Liu X, Yang J, Guo L, Yu X, Wang S . Design and calibration model of a bioinspired attitude and heading reference system based on compound eye polarization compass. Bioinspir Biomim. 2020; 16(1):016001. DOI: 10.1088/1748-3190/abb520. View

13.

Li G, Zhang Y, Fan S, Liu C, Yu F, Wei X . Attitude and heading measurement based on adaptive complementary Kalman filter for PS/MIMU integrated system. Opt Express. 2024; 32(6):9184-9200. DOI: 10.1364/OE.519417. View

14.

Morel O, Seulin R, Fofi D . Handy method to calibrate division-of-amplitude polarimeters for the first three Stokes parameters. Opt Express. 2016; 24(12):13634-46. DOI: 10.1364/OE.24.013634. View

15.

Zeng X, Luo Y, Zhao X, Ye W . An end-to-end fully-convolutional neural network for division of focal plane sensors to reconstruct S, DoLP, and AoP. Opt Express. 2019; 27(6):8566-8577. DOI: 10.1364/OE.27.008566. View

16.

Tu X, McEldowney S, Zou Y, Smith M, Guido C, Brock N . Division of focal plane red-green-blue full-Stokes imaging polarimeter. Appl Opt. 2020; 59(22):G33-G40. DOI: 10.1364/AO.391027. View

17.

Cao S, Gao H, You J . In-Flight Alignment of Integrated SINS/GPS/Polarization/Geomagnetic Navigation System Based on Federal UKF. Sensors (Basel). 2022; 22(16). PMC: 9416158. DOI: 10.3390/s22165985. View

18.

Xiang K, Yang K, Wang K . Polarization-driven semantic segmentation via efficient attention-bridged fusion. Opt Express. 2021; 29(4):4802-4820. DOI: 10.1364/OE.416130. View

19.

Tibbs A, Daly I, Roberts N, Bull D . Denoising imaging polarimetry by adapted BM3D method. J Opt Soc Am A Opt Image Sci Vis. 2018; 35(4):690-701. DOI: 10.1364/JOSAA.35.000690. View

20.

Voss K, Liu Y . Polarized radiance distribution measurements of skylight. I. System description and characterization. Appl Opt. 1997; 36(24):6083-94. DOI: 10.1364/ao.36.006083. View