arXiv:2507.05815eess.IVcs.LG2025-07被引 1

用好坏反馈代替手动标注,实现医疗图像分割的高效人机协作。

Beyond Manual Annotation: A Human-AI Collaborative Framework for Medical Image Segmentation Using Only "Better or Worse" Expert Feedback

  • 专家仅需判断AI分割结果好坏,无需逐像素标注。
  • 在三个公开数据集上达到媲美人工标注的分割精度。
  • 适合需要快速迭代但缺乏标注资源的医疗AI团队。

医学图像的手动标注耗时耗力,严重制约了医学影像AI系统的开发与应用。本文提出一种无需手动像素标注的全新人机协同框架,核心是偏好学习机制:专家仅需判断AI生成的分割结果是否优于前一版本。框架包含四个关键组件:(1) 可适应的基础模型(FM)用于特征提取,(2) 基于特征相似性的标签传播,(3) 从专家好坏反馈中学习点击位置与标签的点击代理,(4) 多轮分割学习流程,利用点击代理生成的伪标签和FM-based标签传播训练先进分割网络。在三个公开数据集上的实验表明,该方法仅通过二元偏好反馈即可实现具有竞争力的分割性能,无需专家进行直接手动标注。

原文摘要 · Abstract (English)

Manual annotation of medical images is a labor-intensive and time-consuming process, posing a significant bottleneck in the development and deployment of robust medical imaging AI systems. This paper introduces a novel hands-free Human-AI collaborative framework for medical image segmentation that substantially reduces the annotation burden by eliminating the need for explicit manual pixel-level labeling. The core innovation lies in a preference learning paradigm, where human experts provide minimal, intuitive feedback -- simply indicating whether an AI-generated segmentation is better or worse than a previous version. The framework comprises four key components: (1) an adaptable foundation model (FM) for feature extraction, (2) label propagation based on feature similarity, (3) a clicking agent that learns from human better-or-worse feedback to decide where to click and with which label, and (4) a multi-round segmentation learning procedure that trains a state-of-the-art segmentation network using pseudo-labels generated by the clicking agent and FM-based label propagation. Experiments on three public datasets demonstrate that the proposed approach achieves competitive segmentation performance using only binary preference feedback, without requiring experts to directly manually annotate the images.

医学图像人机协作偏好学习少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。