arXiv:2409.14874eess.IVcs.AI2024-09被引 4

无需真实标签即可评估医学图像分割质量,提升AI辅助诊断可靠性。

Towards Ground-truth-free Evaluation of Any Segmentation in Medical Images

  • 基于输入图像与分割结果的一致性,构建无真值评估模型
  • 在多个公开数据集上训练,使用Dice分数作为监督信号
  • 适合用于自动筛选劣质分割、模型对比和人机协作预警

本文探索了构建无真值评估模型以衡量分割任意模型(如SAM及其变体)在医学图像中分割质量的可行性与潜力。该模型通过分析输入图像与其对应分割预测之间的连贯性和一致性来估计分割质量得分。基于已有研究,将训练任务建模为监督学习中的回归问题,采用Dice分数(及可选其他指标)与均方误差计算损失函数。模型利用包含大量公开医学图像数据集及SAM及其变体生成分割结果的集合进行训练。命名该模型为EvanySeg(Evaluation of Any Segmentation in Medical Images)。对卷积型(如ResNet)和基于Transformer的模型(如ViT)的探索表明,ViT在该任务上表现更优。EvanySeg可用于多种场景:(1) 通过识别低分位数得分检测低质量分割样本;(2) 在无真值条件下通过测试样本平均得分对分割模型进行基准测试;(3) 在人机协作中,通过设定得分阈值向专家发出劣质预测警报;(4) 当存在多个分割模型时,选择测试样本中得分最高的预测作为最优结果。代码与模型将在https://github.com/ahjolsenbics/EvanySeg发布。

原文摘要 · Abstract (English)

We explore the feasibility and potential of building a ground-truth-free evaluation model to assess the quality of segmentations generated by the Segment Anything Model (SAM) and its variants in medical imaging. This evaluation model estimates segmentation quality scores by analyzing the coherence and consistency between the input images and their corresponding segmentation predictions. Based on prior research, we frame the task of training this model as a regression problem within a supervised learning framework, using Dice scores (and optionally other metrics) along with mean squared error to compute the training loss. The model is trained utilizing a large collection of public datasets of medical images with segmentation predictions from SAM and its variants. We name this model EvanySeg (Evaluation of Any Segmentation in Medical Images). Our exploration of convolution-based models (e.g., ResNet) and transformer-based models (e.g., ViT) suggested that ViT yields better performance for this task. EvanySeg can be employed for various tasks, including: (1) identifying poorly segmented samples by detecting low-percentile segmentation quality scores; (2) benchmarking segmentation models without ground truth by averaging quality scores across test samples; (3) alerting human experts to poor-quality segmentation predictions during human-AI collaboration by applying a threshold within the score space; and (4) selecting the best segmentation prediction for each test sample at test time when multiple segmentation models are available, by choosing the prediction with the highest quality score. Models and code will be made available at https://github.com/ahjolsenbics/EvanySeg.

医学图像无真值评估分割质量ViT

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。