ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays
Overview
Affiliations
Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (n=21). On average, we found that gaze estimates are reported with an angular accuracy of 0.83 degrees and a precision of 0.27 degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.
Krauze L, Panke K, Krumina G, Pladere T Sensors (Basel). 2025; 24(24.
PMID: 39771937 PMC: 11678997. DOI: 10.3390/s24248198.
A review of machine learning in scanpath analysis for passive gaze-based interaction.
Mohamed Selim A, Barz M, Bhatti O, Alam H, Sonntag D Front Artif Intell. 2024; 7:1391745.
PMID: 38903158 PMC: 11188426. DOI: 10.3389/frai.2024.1391745.
A method for synchronized use of EEG and eye tracking in fully immersive VR.
Larsen O, Tresselt W, Lorenz E, Holt T, Sandstrak G, Hansen T Front Hum Neurosci. 2024; 18:1347974.
PMID: 38468815 PMC: 10925625. DOI: 10.3389/fnhum.2024.1347974.
Model-Based 3D Gaze Estimation Using a TOF Camera.
Shen K, Li Y, Guo Z, Gao J, Wu Y Sensors (Basel). 2024; 24(4).
PMID: 38400227 PMC: 10891597. DOI: 10.3390/s24041070.
Leharanger M, Rodriguez Martinez E, Baledent O, Vandromme L Sensors (Basel). 2023; 23(14).
PMID: 37514598 PMC: 10383879. DOI: 10.3390/s23146304.