无需标注,用仿真数据让分割模型精准识别血管造影中的导丝。
Generalizing Segmentation Foundation Model Under Sim-to-real Domain-shift for Guidewire Segmentation in X-ray Fluoroscopy
- 先用风格迁移生成伪标签,再通过师生自训练逐步优化模型。
- 在两个真实数据集上表现超越预训练SAM和现有最优方法。
- 适合医疗影像领域,尤其缺乏标注的复杂场景应用。
血管内介入手术中导丝分割可显著提升操作精度,改善可视化并为医生与机器人系统提供关键反馈。与依赖大量人工标注的监督分割网络不同,模拟到真实域自适应方法利用仿真数据,降低成本。尽管像Segment-Anything(SAM)这类基础分割模型在零样本/少样本泛化方面取得进展,但在X射线荧光透视等医学图像及域偏移问题上仍表现不佳。鉴于标注成本高而仿真标注数据易得,本文提出一种无目标域标注的模拟到真实域自适应框架,采用粗到细策略将SAM适配至X射线荧光透视导丝分割任务。首先通过简单源图像风格迁移技术生成保持导丝结构的伪标签;随后设计弱监督自训练架构,以一致性正则化与教师网络监督,端到端微调学生版SAM。在公开心脏数据集和自研神经血管数据集上验证,本方法显著优于预训练SAM及多种先进域自适应技术。代码即将开源。
原文摘要 · Abstract (English)
Guidewire segmentation during endovascular interventions holds the potential to significantly enhance procedural accuracy, improving visualization and providing critical feedback that can support both physicians and robotic systems in navigating complex vascular pathways. Unlike supervised segmentation networks, which need many expensive expert-annotated labels, sim-to-real domain adaptation approaches utilize synthetic data from simulations, offering a cost-effective solution. The success of models like Segment-Anything (SAM) has driven advancements in image segmentation foundation models with strong zero/few-shot generalization through prompt engineering. However, they struggle with medical images like X-ray fluoroscopy and the domain-shifts of the data. Given the challenges of acquiring annotation and the accessibility of labeled simulation data, we propose a sim-to-real domain adaption framework with a coarse-to-fine strategy to adapt SAM to X-ray fluoroscopy guidewire segmentation without any annotation on the target domain. We first generate the pseudo-labels by utilizing a simple source image style transfer technique that preserves the guidewire structure. Then, we develop a weakly supervised self-training architecture to fine-tune an end-to-end student SAM with the coarse labels by imposing consistency regularization and supervision from the teacher SAM network. We validate the effectiveness of the proposed method on a publicly available Cardiac dataset and an in-house Neurovascular dataset, where our method surpasses both pre-trained SAM and many state-of-the-art domain adaptation techniques by a large margin. Our code will be made public on GitHub soon.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。