Blending Space and Time to Talk About Cancer in Extended Reality

Overview

Journal NPJ Digit Med

Specialty Medical Informatics

Date 2024 Sep 29

PMID 39343807

Authors

Tamsin J Robb

Yinan Liu

Braden Woodhouse

Charlotta Windahl

Daniel Hurley

Grant McArthur

Stephen B Fox

Lisa Brown

Parry Guilford

Alice Minhinnick

Christopher Jackson

Cherie Blenkiron

Kate Parker

Kimiora Henare

Rose McColl

Bianca Haux

Nick Young

Veronica Boyle

Laird Cameron

Sanjeev Deva

Jane Reeve

Cristin G Print

Michael Davis

Uwe Rieger

Ben Lawrence

Affiliations

Soon will be listed here.

Abstract

We introduce a proof-of-concept extended reality (XR) environment for discussing cancer, presenting genomic information from multiple tumour sites in the context of 3D tumour models generated from CT scans. This tool enhances multidisciplinary discussions. Clinicians and cancer researchers explored its use in oncology, sharing perspectives on XR's potential for use in molecular tumour boards, clinician-patient communication, and education. XR serves as a universal language, fostering collaborative decision-making in oncology.

References

Sharp P, Langer R . Research agenda. Promoting convergence in biomedical science. Science. 2011; 333(6042):527. DOI: 10.1126/science.1205008. View

Falagas M, Korbila I, Giannopoulou K, Kondilis B, Peppas G . Informed consent: how much and what do patients understand?. Am J Surg. 2009; 198(3):420-35. DOI: 10.1016/j.amjsurg.2009.02.010. View

Henare K, Parker K, Wihongi H, Blenkiron C, Jansen R, Reid P . Mapping a route to Indigenous engagement in cancer genomic research. Lancet Oncol. 2019; 20(6):e327-e335. DOI: 10.1016/S1470-2045(19)30307-9. View

Russo A, Incorvaia L, Capoluongo E, Tagliaferri P, Galvano A, Del Re M . The challenge of the Molecular Tumor Board empowerment in clinical oncology practice: A Position Paper on behalf of the AIOM- SIAPEC/IAP-SIBioC-SIC-SIF-SIGU-SIRM Italian Scientific Societies. Crit Rev Oncol Hematol. 2021; 169:103567. DOI: 10.1016/j.critrevonc.2021.103567. View

Qu Z, Lau C, Nguyen Q, Zhou Y, Catchpoole D . Visual Analytics of Genomic and Cancer Data: A Systematic Review. Cancer Inform. 2019; 18:1176935119835546. PMC: 6416684. DOI: 10.1177/1176935119835546. View

Blenkiron C, Robb T, Parker K, Kramer N, Stables S, Tse R . Tailoring a rapid autopsy protocol to explore cancer evolution: a patient collaboration. N Z Med J. 2019; 132(1503):83-92. View

Erdmann J . All aboard: Will molecular tumor boards help cancer patients?. Nat Med. 2015; 21(7):655-6. DOI: 10.1038/nm0715-655. View

Sivananthan A, Gueroult A, Zijlstra G, Martin G, Baheerathan A, Pratt P . Using Mixed Reality Headsets to Deliver Remote Bedside Teaching During the COVID-19 Pandemic: Feasibility Trial of HoloLens 2. JMIR Form Res. 2022; 6(5):e35674. PMC: 9116455. DOI: 10.2196/35674. View

Phelps E, Wellings R, Griffiths F, Hutchinson C, Kunar M . Do medical images aid understanding and recall of medical information? An experimental study comparing the experience of viewing no image, a 2D medical image and a 3D medical image alongside a diagnosis. Patient Educ Couns. 2017; 100(6):1120-1127. DOI: 10.1016/j.pec.2016.12.034. View

10.

Ortiz-Catalan M, Sander N, Kristoffersen M, Hakansson B, Branemark R . Treatment of phantom limb pain (PLP) based on augmented reality and gaming controlled by myoelectric pattern recognition: a case study of a chronic PLP patient. Front Neurosci. 2014; 8:24. PMC: 3935120. DOI: 10.3389/fnins.2014.00024. View

11.

Rolfo C, Manca P, Salgado R, van Dam P, Dendooven A, Ferri Gandia J . Multidisciplinary molecular tumour board: a tool to improve clinical practice and selection accrual for clinical trials in patients with cancer. ESMO Open. 2018; 3(5):e000398. PMC: 6069914. DOI: 10.1136/esmoopen-2018-000398. View

12.

Pires F, Costa C, Dias P . On the Use of Virtual Reality for Medical Imaging Visualization. J Digit Imaging. 2021; 34(4):1034-1048. PMC: 8455774. DOI: 10.1007/s10278-021-00480-z. View

13.

Liimatainen K, Latonen L, Valkonen M, Kartasalo K, Ruusuvuori P . Virtual reality for 3D histology: multi-scale visualization of organs with interactive feature exploration. BMC Cancer. 2021; 21(1):1133. PMC: 8539837. DOI: 10.1186/s12885-021-08542-9. View

14.

Saadatmand S, Bretveld R, Siesling S, Tilanus-Linthorst M . Influence of tumour stage at breast cancer detection on survival in modern times: population based study in 173,797 patients. BMJ. 2015; 351:h4901. PMC: 4595560. DOI: 10.1136/bmj.h4901. View

15.

Pishvaian M, Blais E, Bender R, Rao S, Boca S, Chung V . A virtual molecular tumor board to improve efficiency and scalability of delivering precision oncology to physicians and their patients. JAMIA Open. 2020; 2(4):505-515. PMC: 6994017. DOI: 10.1093/jamiaopen/ooz045. View

16.

Pratt P, Ives M, Lawton G, Simmons J, Radev N, Spyropoulou L . Through the HoloLens™ looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels. Eur Radiol Exp. 2018; 2(1):2. PMC: 5909360. DOI: 10.1186/s41747-017-0033-2. View

17.

Fittall M, Van Loo P . Translating insights into tumor evolution to clinical practice: promises and challenges. Genome Med. 2019; 11(1):20. PMC: 6440005. DOI: 10.1186/s13073-019-0632-z. View

18.

Kato S, Kim K, Lim H, Boichard A, Nikanjam M, Weihe E . Real-world data from a molecular tumor board demonstrates improved outcomes with a precision N-of-One strategy. Nat Commun. 2020; 11(1):4965. PMC: 7532150. DOI: 10.1038/s41467-020-18613-3. View

19.

Robb T, Tse R, Blenkiron C . Reviving the Autopsy for Modern Cancer Evolution Research. Cancers (Basel). 2021; 13(3). PMC: 7866143. DOI: 10.3390/cancers13030409. View

20.

Lau C, Qu Z, Draper D, Quan R, Braytee A, Bluff A . Virtual reality for the observation of oncology models (VROOM): immersive analytics for oncology patient cohorts. Sci Rep. 2022; 12(1):11337. PMC: 9256599. DOI: 10.1038/s41598-022-15548-1. View