arXiv:2601.13954cs.CV2026-01被引 1

用点标注训练医学影像目标检测,大幅降低标注成本。

DExTeR: Weakly Semi-Supervised Object Detection with Class and Instance Experts for Medical Imaging

  • 将单点标注转为框,用专家机制区分同类与邻近结构
  • 在三个医学数据集上超越现有方法,最高提升4.2% mAP
  • 适合医疗影像检测、标注成本敏感的研究者

医学影像中解剖标志物的检测对诊断和手术引导至关重要。但目标检测模型依赖昂贵的边界框标注,限制了可扩展性。弱监督半监督目标检测(WSSOD)通过单点标注方式,仅需每实例一个点,显著减少标注时间,同时保留定位信号。现有方法使用基于小规模框标注子集训练的点到框教师模型,生成伪框标签用于学生检测器训练。然而,医学影像存在重叠解剖结构、物体大小差异大、结构隐匿等挑战,影响框推断准确性。为此,我们提出DExTeR(DETR with Experts),一种面向医学影像的Transformer点到框回归器。基于Point-DETR,DExTeR将单点标注编码为对象查询,并引入类引导可变形注意力机制,利用点坐标和类别标签引导注意力采样,捕捉类别特异性特征。为增强复杂结构的判别能力,设计CLICK-MoE(类、实例与共知知识混合专家),解耦类别与实例表示,减少相邻或重叠实例间的混淆。最后,采用多点训练策略,促进不同点位放置下预测的一致性,提升对标注变异的鲁棒性。DExTeR在三个涵盖内窥镜、胸部X光和内窥超声的不同医学领域数据集上达到当前最优性能,验证了其在降低标注成本的同时保持高检测精度的潜力。

原文摘要 · Abstract (English)

Detecting anatomical landmarks in medical imaging is essential for diagnosis and intervention guidance. However, object detection models rely on costly bounding box annotations, limiting scalability. Weakly Semi-Supervised Object Detection (WSSOD) with point annotations proposes annotating each instance with a single point, minimizing annotation time while preserving localization signals. A Point-to-Box teacher model, trained on a small box-labeled subset, converts these point annotations into pseudo-box labels to train a student detector. Yet, medical imagery presents unique challenges, including overlapping anatomy, variable object sizes, and elusive structures, which hinder accurate bounding box inference. To overcome these challenges, we introduce DExTeR (DETR with Experts), a transformer-based Point-to-Box regressor tailored for medical imaging. Built upon Point-DETR, DExTeR encodes single-point annotations as object queries, refining feature extraction with the proposed class-guided deformable attention, which guides attention sampling using point coordinates and class labels to capture class-specific characteristics. To improve discrimination in complex structures, it introduces CLICK-MoE (CLass, Instance, and Common Knowledge Mixture of Experts), decoupling class and instance representations to reduce confusion among adjacent or overlapping instances. Finally, we implement a multi-point training strategy which promotes prediction consistency across different point placements, improving robustness to annotation variability. DExTeR achieves state-of-the-art performance across three datasets spanning different medical domains (endoscopy, chest X-rays, and endoscopic ultrasound) highlighting its potential to reduce annotation costs while maintaining high detection accuracy.

医学影像弱监督目标检测点标注

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。