Real-time CBCT Imaging and Motion Tracking Via a Single Arbitrarily-angled X-ray Projection by a Joint Dynamic Reconstruction and Motion Estimation (DREME) Framework

Overview

Journal Phys Med Biol

Publisher IOP Publishing

Specialties Biophysics
Nuclear Medicine
Radiology

Date 2025 Jan 2

PMID 39746309

Authors

Hua-Chieh Shao

Tielige Mengke

Tinsu Pan

You Zhang

Affiliations

Soon will be listed here.

Abstract

Real-time cone-beam computed tomography (CBCT) provides instantaneous visualization of patient anatomy for image guidance, motion tracking, and online treatment adaptation in radiotherapy. While many real-time imaging and motion tracking methods leveraged patient-specific prior information to alleviate under-sampling challenges and meet the temporal constraint (<500 ms), the prior information can be outdated and introduce biases, thus compromising the imaging and motion tracking accuracy. To address this challenge, we developed a frameworkynamicconstruction andotionstimation (DREME) for real-time CBCT imaging and motion estimation, without relying on patient-specific prior knowledge.DREME incorporates a deep learning-based real-time CBCT imaging and motion estimation method into a dynamic CBCT reconstruction framework. The reconstruction framework reconstructs a dynamic sequence of CBCTs in a data-driven manner from a standard pre-treatment scan, without requiring patient-specific prior knowledge. Meanwhile, a convolutional neural network-based motion encoder is jointly trained during the reconstruction to learn motion-related features relevant for real-time motion estimation, based on a single arbitrarily-angled x-ray projection. DREME was tested on digital phantom simulations and real patient studies.DREME accurately solved 3D respiration-induced anatomical motion in real time (∼1.5 ms inference time for each x-ray projection). For the digital phantom studies, it achieved an average lung tumor center-of-mass localization error of 1.2 ± 0.9 mm (Mean ± SD). For the patient studies, it achieved a real-time tumor localization accuracy of 1.6 ± 1.6 mm in the projection domain.DREME achieves CBCT and volumetric motion estimation in real time from a single x-ray projection at arbitrary angles, paving the way for future clinical applications in intra-fractional motion management. In addition, it can be used for dose tracking and treatment assessment, when combined with real-time dose calculation.

References

Li R, Lewis J, Jia X, Zhao T, Liu W, Wuenschel S . On a PCA-based lung motion model. Phys Med Biol. 2011; 56(18):6009-30. PMC: 3915048. DOI: 10.1088/0031-9155/56/18/015. View

Lu J, Guerrero T, Munro P, Jeung A, Chi P, Balter P . Four-dimensional cone beam CT with adaptive gantry rotation and adaptive data sampling. Med Phys. 2007; 34(9):3520-9. DOI: 10.1118/1.2767145. View

Ou Z, Xie J, Teng Z, Wang X, Jin P, Du J . PNMC: Four-dimensional conebeam CT reconstruction combining prior network and motion compensation. Comput Biol Med. 2024; 171:108145. DOI: 10.1016/j.compbiomed.2024.108145. View

Keall P, Poulsen P, Booth J . See, Think, and Act: Real-Time Adaptive Radiotherapy. Semin Radiat Oncol. 2019; 29(3):228-235. DOI: 10.1016/j.semradonc.2019.02.005. View

Shieh C, Gonzalez Y, Li B, Jia X, Rit S, Mory C . SPARE: Sparse-view reconstruction challenge for 4D cone-beam CT from a 1-min scan. Med Phys. 2019; 46(9):3799-3811. PMC: 6739166. DOI: 10.1002/mp.13687. View

Shao H, Wang J, Bai T, Chun J, Park J, Jiang S . Real-time liver tumor localization via a single x-ray projection using deep graph neural network-assisted biomechanical modeling. Phys Med Biol. 2022; 67(11). PMC: 9233941. DOI: 10.1088/1361-6560/ac6b7b. View

Rashid A, Ahmad Z, Memon M, Hashim A . Volumetric Modulated Arc Therapy (VMAT): A modern radiotherapy technique - A single institutional experience. Pak J Med Sci. 2021; 37(2):355-361. PMC: 7931288. DOI: 10.12669/pjms.37.2.2647. View

Bernier J, Hall E, Giaccia A . Radiation oncology: a century of achievements. Nat Rev Cancer. 2004; 4(9):737-47. DOI: 10.1038/nrc1451. View

Zhou D, Nakamura M, Mukumoto N, Yoshimura M, Mizowaki T . Development of a deep learning-based patient-specific target contour prediction model for markerless tumor positioning. Med Phys. 2022; 49(3):1382-1390. DOI: 10.1002/mp.15456. View

10.

Tong F, Nakao M, Wu S, Nakamura M, Matsuda T . X-ray2Shape: Reconstruction of 3D Liver Shape from a Single 2D Projection Image. Annu Int Conf IEEE Eng Med Biol Soc. 2020; 2020:1608-1611. DOI: 10.1109/EMBC44109.2020.9176655. View

11.

Zhang Y, Shao H, Pan T, Mengke T . Dynamic cone-beam CT reconstruction using spatial and temporal implicit neural representation learning (STINR). Phys Med Biol. 2023; 68(4). PMC: 10087494. DOI: 10.1088/1361-6560/acb30d. View

12.

Segars W, Sturgeon G, Mendonca S, Grimes J, Tsui B . 4D XCAT phantom for multimodality imaging research. Med Phys. 2010; 37(9):4902-15. PMC: 2941518. DOI: 10.1118/1.3480985. View

13.

Xu Q, Hanna G, Grimm J, Kubicek G, Pahlajani N, Asbell S . Quantifying rigid and nonrigid motion of liver tumors during stereotactic body radiation therapy. Int J Radiat Oncol Biol Phys. 2014; 90(1):94-101. DOI: 10.1016/j.ijrobp.2014.05.007. View

14.

Keall P, Sawant A, Berbeco R, Booth J, Cho B, Cervino L . AAPM Task Group 264: The safe clinical implementation of MLC tracking in radiotherapy. Med Phys. 2020; 48(5):e44-e64. DOI: 10.1002/mp.14625. View

15.

Roman N, Shepherd W, Mukhopadhyay N, Hugo G, Weiss E . Interfractional positional variability of fiducial markers and primary tumors in locally advanced non-small-cell lung cancer during audiovisual biofeedback radiotherapy. Int J Radiat Oncol Biol Phys. 2012; 83(5):1566-72. DOI: 10.1016/j.ijrobp.2011.10.051. View

16.

Shen L, Pauly J, Xing L . NeRP: Implicit Neural Representation Learning With Prior Embedding for Sparsely Sampled Image Reconstruction. IEEE Trans Neural Netw Learn Syst. 2022; PP. PMC: 10889906. DOI: 10.1109/TNNLS.2022.3177134. View

17.

Seppenwoolde Y, Shirato H, Kitamura K, Shimizu S, Van Herk M, Lebesque J . Precise and real-time measurement of 3D tumor motion in lung due to breathing and heartbeat, measured during radiotherapy. Int J Radiat Oncol Biol Phys. 2002; 53(4):822-34. DOI: 10.1016/s0360-3016(02)02803-1. View

18.

Shirato H, Seppenwoolde Y, Kitamura K, Onimura R, Shimizu S . Intrafractional tumor motion: lung and liver. Semin Radiat Oncol. 2004; 14(1):10-8. DOI: 10.1053/j.semradonc.2003.10.008. View

19.

Keall P, Mageras G, Balter J, Emery R, Forster K, Jiang S . The management of respiratory motion in radiation oncology report of AAPM Task Group 76. Med Phys. 2006; 33(10):3874-900. DOI: 10.1118/1.2349696. View

20.

Mylonas A, Booth J, Nguyen D . A review of artificial intelligence applications for motion tracking in radiotherapy. J Med Imaging Radiat Oncol. 2021; 65(5):596-611. DOI: 10.1111/1754-9485.13285. View