arXiv:2508.10260eess.IVcs.AI2025-08中稿 · IEEE Transactions …被引 2

用DINOv2+LoRA实现快速精准的医学影像运动追踪,提升放疗安全性。

DINOMotion: advanced robust tissue motion tracking with DINOv2 in 2D-Cine MRI-guided radiotherapy

  • 基于DINOv2与LoRA构建端到端运动追踪框架,自动定位对应点。
  • 在肾、肝、肺上达92%以上分割重合率,最大误差仅6.72毫米。
  • 30毫秒内完成每帧处理,适合实时放疗系统,结果可解释性强。

精确的组织运动追踪对2D-Cine MRI引导放疗的疗效和安全至关重要。传统方法依赖序列图像配准,但常面临大位移和可解释性差的问题。本文提出DINOMotion,一种基于DINOv2与低秩适配(LoRA)层的深度学习框架,实现鲁棒、高效且可解释的运动追踪。该方法自动检测对应关键点以推导最优图像配准,通过显式视觉对应关系增强可解释性。LoRA层减少可训练参数,提升训练效率;DINOv2强大的特征表示则增强了对大位移的鲁棒性。与迭代优化方法不同,DINOMotion在测试时直接计算配准。在志愿者和患者数据集上的实验表明,其能有效估计线性和非线性变换,肾脏Dice分数达92.07%,肝脏90.90%,肺95.23%,相应豪斯多夫距离分别为5.47毫米、8.31毫米、6.72毫米。DINOMotion每扫描处理约30毫秒,显著优于现有先进方法,尤其在大位移场景下表现突出,展现出作为实时运动追踪解决方案的巨大潜力。

原文摘要 · Abstract (English)

Accurate tissue motion tracking is critical to ensure treatment outcome and safety in 2D-Cine MRI-guided radiotherapy. This is typically achieved by registration of sequential images, but existing methods often face challenges with large misalignments and lack of interpretability. In this paper, we introduce DINOMotion, a novel deep learning framework based on DINOv2 with Low-Rank Adaptation (LoRA) layers for robust, efficient, and interpretable motion tracking. DINOMotion automatically detects corresponding landmarks to derive optimal image registration, enhancing interpretability by providing explicit visual correspondences between sequential images. The integration of LoRA layers reduces trainable parameters, improving training efficiency, while DINOv2's powerful feature representations offer robustness against large misalignments. Unlike iterative optimization-based methods, DINOMotion directly computes image registration at test time. Our experiments on volunteer and patient datasets demonstrate its effectiveness in estimating both linear and nonlinear transformations, achieving Dice scores of 92.07% for the kidney, 90.90% for the liver, and 95.23% for the lung, with corresponding Hausdorff distances of 5.47 mm, 8.31 mm, and 6.72 mm, respectively. DINOMotion processes each scan in approximately 30ms and consistently outperforms state-of-the-art methods, particularly in handling large misalignments. These results highlight its potential as a robust and interpretable solution for real-time motion tracking in 2D-Cine MRI-guided radiotherapy.

医学影像运动追踪DINOv2放疗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。