用大模型生成猪心脏CT伪标签,实现无需人工标注的自动分割。
Using Foundation Models as Pseudo-Label Generators for Pre-Clinical 4D Cardiac CT Segmentation
- 用人类数据训练的大模型生成猪心CT伪标签,再通过自迭代优化提升精度。
- 无需人工标注即可实现高精度分割,且改善了时间序列帧间不连续问题。
- 适合缺乏标注数据的动物实验研究者,尤其关注心脏动态建模的团队。
心脏图像分割是心脏影像分析与建模(如运动追踪或力学模拟)的关键步骤。尽管深度学习在临床应用中已取得显著进展,但针对前临床影像(尤其是猪模型)的研究仍较少。由于物种差异导致域偏移,直接将人类模型迁移到猪数据存在困难。近期,基于大规模人类数据训练的通用模型在医学图像分割中展现出潜力,但其在猪类数据上的适用性尚未被充分探索。本文研究通用模型是否可为猪心脏CT生成足够准确的伪标签,并提出一种简单的自训练方法,通过迭代更新逐步优化标签质量。该方法完全无需人工标注的猪数据,仅依赖自迭代过程提升分割效果。实验表明,该自训练流程不仅提升了分割精度,还有效缓解了连续帧间的时序不一致性。尽管结果令人鼓舞,仍有改进空间,例如引入更复杂的自训练策略、探索更多通用模型及其它心脏成像技术。
原文摘要 · Abstract (English)
Cardiac image segmentation is an important step in many cardiac image analysis and modeling tasks such as motion tracking or simulations of cardiac mechanics. While deep learning has greatly advanced segmentation in clinical settings, there is limited work on pre-clinical imaging, notably in porcine models, which are often used due to their anatomical and physiological similarity to humans. However, differences between species create a domain shift that complicates direct model transfer from human to pig data. Recently, foundation models trained on large human datasets have shown promise for robust medical image segmentation; yet their applicability to porcine data remains largely unexplored. In this work, we investigate whether foundation models can generate sufficiently accurate pseudo-labels for pig cardiac CT and propose a simple self-training approach to iteratively refine these labels. Our method requires no manually annotated pig data, relying instead on iterative updates to improve segmentation quality. We demonstrate that this self-training process not only enhances segmentation accuracy but also smooths out temporal inconsistencies across consecutive frames. Although our results are encouraging, there remains room for improvement, for example by incorporating more sophisticated self-training strategies and by exploring additional foundation models and other cardiac imaging technologies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。