Uncertainty estimation and evaluation of deformation image registration based convolutional neural networks

Rivetti, Luciano (avtor), Studen, Andrej (avtor), Sharma, Manju (avtor), Chan, Jason (avtor), Jeraj, Robert (avtor)

Objective. Fast and accurate deformable image registration (DIR), including DIR uncertainty estimation, is essential for safe and reliable clinical deployment. While recent deep learning models have shown promise in predicting DIR with its uncertainty, challenges persist in proper uncertainty evaluation and hyperparameter optimization for these methods. This work aims to develop and evaluate a model that can perform fast DIR and predict its uncertainty in seconds. Approach. This study introduces a novel probabilistic multi-resolution image registration model utilizing convolutional neural networks to estimate a multivariate normal distributed dense displacement field (DDF) in a multimodal image registration problem. To assess the quality of the DDFdistribution predicted by the model, we propose a new metric based on the Kullback–Leibler divergence. The performance of our approach was evaluated against three other DIR algorithms (VoxelMorph, Monte Carlo dropout, and Monte Carlo B-spline) capable of predicting uncertainty. The evaluation of the models included not only the quality of the deformation but also the reliability of the estimated uncertainty. Our application investigated the registration of a treatment planning computed tomography (CT) to follow-up cone beam CT for daily adaptive radiotherapy. Main results. The hyperparameter tuning of the models showed a trade-off between the estimated uncertainty’s reliability and the deformation’s accuracy. In the optimal trade-off, our model excelled in contour propagation and uncertainty estimation (p < 0.05) compared to existing uncertainty estimation models. We obtained an average dice similarity coefficient of 0.89 and a KL-divergence of 0.15. Significance. By addressing challenges in DIR uncertainty estimation and evaluation, our work showed that both the DIR and its uncertainty can be reliably predicted, paving the way for safe deployment in a clinical environment.

• Jezik: Angleški jezik
• Ključne besede: medical physics, medical images, deformable image registration, adaptive radiotherapy, deep learning, neural networks, uncertainty estimation
• Vrsta gradiva: Članek v reviji
• Tipologija: 1.01 - Izvirni znanstveni članek
• Organizacija: FMF - Fakulteta za matematiko in fiziko
• Status publikacije: Objavljeno
• Različica publikacije: Objavljena publikacija
• Leto izida: 2024
• Št. strani: 15 str.
• Številčenje: Vol. 69, no. 11, art. no. 115045
• PID: 20.500.12556/RUL-168151
• UDK: 004.93:616-073
• ISSN pri članku: 0031-9155
• DOI: 10.1088/1361-6560/ad4c4f
• COBISS.SI-ID: 230884611
• Datum objave v RUL: 31.03.2025

Gradivo je del revije

• Naslov: Physics in medicine & biology
• Skrajšan naslov: Phys. med. biol.
• Založnik: IOP Publishing, Institute of Physics and Engineering in Medicine
• ISSN: 0031-9155
• COBISS.SI-ID: 26128896

Licence

• Licenca: CC BY 4.0, Creative Commons Priznanje avtorstva 4.0 Mednarodna
• Povezava: http://creativecommons.org/licenses/by/4.0/deed.sl
• Opis: To je standardna licenca Creative Commons, ki daje uporabnikom največ možnosti za nadaljnjo uporabo dela, pri čemer morajo navesti avtorja.

Sekundarni jezik

• Jezik: Slovenski jezik
• Ključne besede: medicinska fizika, medicinske slike, deformabilna poravnava slik, adaptivna radioterapija, globoko učenje, nevronske mreže, ocena negotovosti

Projekti

• Financer: EC - European Commission
• Številka projekta: 955956
• Naslov: Real-time Adaptive Particle Therapy of Cancer
• Akronim: RAPTOR