arXiv:2604.13397cs.CV2026-04

融合临床信息的多模态分阶段配准,提升质子治疗影像精度

A Multimodal Clinically Informed Coarse-to-Fine Framework for Longitudinal CT Registration in Proton Therapy

论文配图:A Multimodal Clinically Informed Coarse-to-Fine Framework for Longitudinal CT Registration in Proton Therapy
图 1 · 摘自论文原文
  • 分阶段框架结合图像与临床数据,逐步优化形变场
  • 在1222对扫描中实现比现有方法更精准的配准结果
  • 适合需高精度配准的质子治疗临床场景

质子治疗虽能更好保护器官,但对解剖变化敏感,因此跨纵向CT扫描的准确非刚性图像配准至关重要。传统方法速度慢,难以适应在线自适应流程;现有深度学习方法多针对通用基准,未充分利用影像之外的临床信息。为此,我们提出一种可临床扩展的多模态粗到精配准框架,整合质子放疗全流程中的多模态信息以适应多样临床场景。模型采用双卷积神经网络编码器进行分层特征提取,结合基于Transformer的解码器逐步细化形变场。除CT强度外,还通过解剖与风险引导注意力、文本条件特征调制及前景感知优化,融合靶区和危及器官轮廓、剂量分布及治疗计划文本等关键临床先验信息,实现解剖聚焦且临床知情的形变估计。我们在包含1,222对计划与重复扫描、覆盖多个解剖区域和疾病类型的大型质子治疗配准数据集上评估该框架。大量实验表明其在性能上持续优于现有最优方法,实现快速且稳健的临床有意义配准。

原文摘要 · Abstract (English)

Proton therapy offers superior organ-at-risk sparing but is highly sensitive to anatomical changes, making accurate deformable image registration (DIR) across longitudinal CT scans essential. Conventional DIR methods are often too slow for emerging online adaptive workflows, while existing deep learning-based approaches are primarily designed for generic benchmarks and underutilize clinically relevant information beyond images. To address this gap, we propose a clinically scalable coarse-to-fine deformable registration framework that integrates multimodal information from the proton radiotherapy workflow to accommodate diverse clinical scenarios. The model employs dual CNN-based encoders for hierarchical feature extraction and a transformer-based decoder to progressively refine deformation fields. Beyond CT intensities, clinically critical priors, including target and organ-at-risk contours, dose distributions, and treatment planning text, are incorporated through anatomy- and risk-guided attention, text-conditioned feature modulation, and foreground-aware optimization, enabling anatomically focused and clinically informed deformation estimation. We evaluate the proposed framework on a large-scale proton therapy DIR dataset comprising 1,222 paired planning and repeat CT scans across multiple anatomical regions and disease types. Extensive experiments demonstrate consistent improvements over state-of-the-art methods, enabling fast and robust clinically meaningful registration.

医学影像形变配准质子治疗多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。