通过多跳视觉推理实现可解释的无监督医学图像配准
Interpretable Unsupervised Deformable Image Registration via Confidence-bound Multi-Hop Visual Reasoning
- 将配准过程建模为多步视觉推理,每步融合局部精修与交叉参考注意力
- 在两个公开数据集上达到竞争性精度,中间结果具可解释性
- 输出变形场置信度,适合临床可信度要求高的场景
无监督可变形图像配准需在无标签情况下对齐复杂解剖结构,可解释性与可靠性至关重要。现有深度学习方法虽精度较高,但缺乏透明度,易导致误差累积并降低临床信任。本文提出多跳视觉推理(VCoR)框架,将配准重构为渐进式推理过程。受临床决策迭代启发,每一步推理集成局部空间精修(LSR)模块以增强特征表达,并引入交叉参考注意力(CRA)机制引导迭代优化,保持解剖一致性。该多跳策略有效处理大形变,生成具有理论置信界的一系列中间预测。除精度外,通过各步变形场的稳定性与收敛性估计不确定性,实现内嵌可解释性。在两个挑战性公开数据集(DIR-Lab 4D CT肺部和IXI T1加权MRI脑部)上的广泛评估表明,VCoR在保持竞争力精度的同时,提供丰富的中间可视化与置信度度量。通过嵌入隐式视觉推理范式,本文呈现一种可解释、可靠且临床可用的无监督医学图像配准方案。
原文摘要 · Abstract (English)
Unsupervised deformable image registration requires aligning complex anatomical structures without reference labels, making interpretability and reliability critical. Existing deep learning methods achieve considerable accuracy but often lack transparency, leading to error drift and reduced clinical trust. We propose a novel Multi-Hop Visual Chain of Reasoning (VCoR) framework that reformulates registration as a progressive reasoning process. Inspired by the iterative nature of clinical decision-making, each visual reasoning hop integrates a Localized Spatial Refinement (LSR) module to enrich feature representations and a Cross-Reference Attention (CRA) mechanism that leads the iterative refinement process, preserving anatomical consistency. This multi-hop strategy enables robust handling of large deformations and produces a transparent sequence of intermediate predictions with a theoretical bound. Beyond accuracy, our framework offers built-in interpretability by estimating uncertainty via the stability and convergence of deformation fields across hops. Extensive evaluations on two challenging public datasets, DIR-Lab 4D CT (lung) and IXI T1-weighted MRI (brain), demonstrate that VCoR achieves competitive registration accuracy while offering rich intermediate visualizations and confidence measures. By embedding an implicit visual reasoning paradigm, we present an interpretable, reliable, and clinically viable unsupervised medical image registration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。