arXiv:2409.05666eess.IVcs.CV2024-09被引 2

用深度学习实现放疗中生物特征的实时分割,速度超快且精度高。

Robust Real-time Segmentation of Bio-Morphological Features in Human Cherenkov Imaging during Radiotherapy via Deep Learning

  • 基于迁移学习,先在眼底图像上预训练,再微调用于放疗成像
  • 平均分割Dice达0.85,单帧处理时间小于0.7毫秒
  • 适合需要实时监控的精准放疗场景,可替代人工标注

切伦科夫成像可在放疗过程中实时可视化兆伏级X射线或电子束的投递情况。图像中呈现的血管等生物形态特征是患者特异性的标识,可用于定位与运动管理的验证,对精准放疗至关重要。然而由于传统图像处理方法速度慢、精度低,至今未有系统性应用。本研究首次提出深度学习框架,实现视频帧率处理。为解决切伦科夫图像中此类特征标注数据稀缺问题,采用迁移学习策略:利用包含20,529张眼底图像及血管标注的基金图数据集预训练ResNet分割模型;随后使用包含1,483张图像(来自19名乳腺癌患者212个治疗分次)的切伦科夫小规模数据集进行微调。该框架在另19名患者中实现了对皮下静脉、疤痕、色素皮肤等生物特征的一致快速分割,平均分割Dice分数达0.85,单实例处理时间低于0.7毫秒。模型在面对输入图像变化时表现出优异稳定性与速度,优于传统人工分割方法,为前瞻性临床中的在线实时分割奠定了基础。

原文摘要 · Abstract (English)

Cherenkov imaging enables real-time visualization of megavoltage X-ray or electron beam delivery to the patient during Radiation Therapy (RT). Bio-morphological features, such as vasculature, seen in these images are patient-specific signatures that can be used for verification of positioning and motion management that are essential to precise RT treatment. However until now, no concerted analysis of this biological feature-based tracking was utilized because of the slow speed and accuracy of conventional image processing for feature segmentation. This study demonstrated the first deep learning framework for such an application, achieving video frame rate processing. To address the challenge of limited annotation of these features in Cherenkov images, a transfer learning strategy was applied. A fundus photography dataset including 20,529 patch retina images with ground-truth vessel annotation was used to pre-train a ResNet segmentation framework. Subsequently, a small Cherenkov dataset (1,483 images from 212 treatment fractions of 19 breast cancer patients) with known annotated vasculature masks was used to fine-tune the model for accurate segmentation prediction. This deep learning framework achieved consistent and rapid segmentation of Cherenkov-imaged bio-morphological features on another 19 patients, including subcutaneous veins, scars, and pigmented skin. Average segmentation by the model achieved Dice score of 0.85 and required less than 0.7 milliseconds processing time per instance. The model demonstrated outstanding consistency against input image variances and speed compared to conventional manual segmentation methods, laying the foundation for online segmentation in real-time monitoring in a prospective setting.

医学影像实时分割深度学习放疗监控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。