Performance of Consumer Wrist-worn Sleep Tracking Devices Compared to Polysomnography: a Meta-analysis

Overview

Journal J Clin Sleep Med

Specialties Neurology
Psychiatry

Date 2024 Nov 1

PMID 39484805

Authors

Young Jeong Lee

Jae Yong Lee

Jae Hoon Cho

Yun Jin Kang

Ji Ho Choi

Affiliations

Soon will be listed here.

Abstract

Study Objectives: The use of sleep tracking devices is increasing as people become more aware of the importance of sleep and interested in monitoring their patterns. With many devices on the market, we conducted a meta-analysis comparing sleep scoring data from consumer wrist-worn sleep tracking devices with polysomnography to validate the accuracy of these devices.

Methods: We retrieved studies from the databases of SCOPUS, EMBASE, Cochrane Library, PubMed, Web of Science, and KoreaMed and OVID Medline up to March 2024. We compared personal data about participants and information on objective sleep parameters.

Results: From 24 studies, data of 798 patient using Fitbit, Jawbone, myCadian watch, WHOOP strap, Garmin, Basis B1, Zulu Watch, Huami Arc, E4 wristband, Fatigue Science Readiband, Apple Watch, or Xiaomi Mi Band 5 were analyzed. There were significant differences in total sleep time (mean difference, -16.854; 95% confidence interval, [-26.332; -7.375]), sleep efficiency (mean difference, -4.691; 95% confidence interval, [-7.079; -2.302]), sleep latency (mean difference, 2.574; 95% confidence interval, [0.606; 4.542]), and wake after sleep onset (mean difference, 13.255; 95% confidence interval, [4.522; 21.988]) between all consumer sleep tracking devices and polysomnography. In subgroup analysis, there was no significant difference in wake after sleep onset between Fitbit and polysomnography. There was also no significant difference in sleep latency between other devices and polysomnography. Fitbit measured sleep latency longer than other devices, and other devices measured wake after sleep onset longer. Based on Begg and Egger's test, there was no publication bias in total sleep time and sleep efficiency.

Conclusions: Wrist-worn sleep tracking devices, although popular, are not as reliable as polysomnography in measuring key sleep parameters such as total sleep time, sleep efficiency, and sleep latency. Physicians and consumers should be aware of their limitations and interpret results carefully, though they can still be useful for tracking general sleep patterns. Further improvements and clinical studies are needed to enhance their accuracy.

Citation: Lee YJ, Lee JY, Cho JH, Kang YJ, Choi JH. Performance of consumer wrist-worn sleep tracking devices compared to polysomnography: a meta-analysis. 2025;21(3):573-582.

References

Jaworski D, Park E . Apple Watch Sleep and Physiological Tracking Compared to Clinically Validated Actigraphy, Ballistocardiography and Polysomnography. Annu Int Conf IEEE Eng Med Biol Soc. 2023; 2023:1-4. DOI: 10.1109/EMBC40787.2023.10340725. View

Dong X, Yang S, Guo Y, Lv P, Wang M, Li Y . Validation of Fitbit Charge 4 for assessing sleep in Chinese patients with chronic insomnia: A comparison against polysomnography and actigraphy. PLoS One. 2022; 17(10):e0275287. PMC: 9578631. DOI: 10.1371/journal.pone.0275287. View

Devine J, Chinoy E, Markwald R, Schwartz L, Hursh S . Validation of Zulu Watch against Polysomnography and Actigraphy for On-Wrist Sleep-Wake Determination and Sleep-Depth Estimation. Sensors (Basel). 2020; 21(1). PMC: 7796293. DOI: 10.3390/s21010076. View

Scott H, Lovato N, Lack L . The Development and Accuracy of the THIM Wearable Device for Estimating Sleep and Wakefulness. Nat Sci Sleep. 2021; 13:39-53. PMC: 7811468. DOI: 10.2147/NSS.S287048. View

de Zambotti M, Goldstone A, Claudatos S, Colrain I, Baker F . A validation study of Fitbit Charge 2™ compared with polysomnography in adults. Chronobiol Int. 2017; 35(4):465-476. DOI: 10.1080/07420528.2017.1413578. View

Berryhill S, Morton C, Dean A, Berryhill A, Provencio-Dean N, Patel S . Effect of wearables on sleep in healthy individuals: a randomized crossover trial and validation study. J Clin Sleep Med. 2020; 16(5):775-783. PMC: 7849816. DOI: 10.5664/jcsm.8356. View

Hirshkowitz M . Normal human sleep: an overview. Med Clin North Am. 2004; 88(3):551-65, vii. DOI: 10.1016/j.mcna.2004.01.001. View

Regalia G, Gerboni G, Migliorini M, Lai M, Pham J, Puri N . Sleep assessment by means of a wrist actigraphy-based algorithm: agreement with polysomnography in an ambulatory study on older adults. Chronobiol Int. 2020; 38(3):400-414. DOI: 10.1080/07420528.2020.1835942. View

Epstein L, Kristo D, Strollo Jr P, Friedman N, Malhotra A, Patil S . Clinical guideline for the evaluation, management and long-term care of obstructive sleep apnea in adults. J Clin Sleep Med. 2009; 5(3):263-76. PMC: 2699173. View

10.

Concheiro-Moscoso P, Groba B, Alvarez-Estevez D, Miranda-Duro M, Pousada T, Nieto-Riveiro L . Quality of Sleep Data Validation From the Xiaomi Mi Band 5 Against Polysomnography: Comparison Study. J Med Internet Res. 2023; 25:e42073. PMC: 10238963. DOI: 10.2196/42073. View

11.

Cheung J, Leary E, Lu H, Zeitzer J, Mignot E . PSG Validation of minute-to-minute scoring for sleep and wake periods in a consumer wearable device. PLoS One. 2020; 15(9):e0238464. PMC: 7498244. DOI: 10.1371/journal.pone.0238464. View

12.

Miller D, Lastella M, Scanlan A, Bellenger C, Halson S, Roach G . A validation study of the WHOOP strap against polysomnography to assess sleep. J Sports Sci. 2020; 38(22):2631-2636. DOI: 10.1080/02640414.2020.1797448. View

13.

Ellender C, Zahir S, Meaklim H, Joyce R, Cunnington D, Swieca J . Prospective cohort study to evaluate the accuracy of sleep measurement by consumer-grade smart devices compared with polysomnography in a sleep disorders population. BMJ Open. 2021; 11(11):e044015. PMC: 8578969. DOI: 10.1136/bmjopen-2020-044015. View

14.

Kundel V, Shah N . Impact of Portable Sleep Testing. Sleep Med Clin. 2017; 12(1):137-147. PMC: 5458525. DOI: 10.1016/j.jsmc.2016.10.006. View

15.

Stucky B, Clark I, Azza Y, Karlen W, Achermann P, Kleim B . Validation of Fitbit Charge 2 Sleep and Heart Rate Estimates Against Polysomnographic Measures in Shift Workers: Naturalistic Study. J Med Internet Res. 2021; 23(10):e26476. PMC: 8527385. DOI: 10.2196/26476. View

16.

Montgomery-Downs H, Insana S, Bond J . Movement toward a novel activity monitoring device. Sleep Breath. 2011; 16(3):913-7. DOI: 10.1007/s11325-011-0585-y. View

17.

Kolla B, Mansukhani S, Mansukhani M . Consumer sleep tracking devices: a review of mechanisms, validity and utility. Expert Rev Med Devices. 2016; 13(5):497-506. DOI: 10.1586/17434440.2016.1171708. View

18.

Kang S, Kang J, Ko K, Park S, Mariani S, Weng J . Validity of a commercial wearable sleep tracker in adult insomnia disorder patients and good sleepers. J Psychosom Res. 2017; 97:38-44. DOI: 10.1016/j.jpsychores.2017.03.009. View

19.

Haghayegh S, Khoshnevis S, Smolensky M, Diller K, Castriotta R . Accuracy of Wristband Fitbit Models in Assessing Sleep: Systematic Review and Meta-Analysis. J Med Internet Res. 2019; 21(11):e16273. PMC: 6908975. DOI: 10.2196/16273. View

20.

Chinoy E, Cuellar J, Huwa K, Jameson J, Watson C, Bessman S . Performance of seven consumer sleep-tracking devices compared with polysomnography. Sleep. 2020; 44(5). PMC: 8120339. DOI: 10.1093/sleep/zsaa291. View