无需专家标注,自动生成文本提示实现多病灶精准定位。
SP-Det: Self-Prompted Dual-Text Fusion for Generalized Multi-Label Lesion Detection
- 自动生成语义与疾病特征双文本提示,替代人工标注。
- 在两个胸片数据集上达到领先检测精度,且无需专家提示。
- 适合临床场景快速部署,尤其适用于标注资源稀缺的环境。
胸部X光自动病灶检测在提升临床诊断方面展现出巨大潜力,可精准定位病理异常。尽管近期可提示检测框架在目标定位上取得显著精度,但现有方法通常依赖人工标注作为提示,劳动密集且不适用于临床。为此,我们提出SP-Det,一种新颖的自提示检测框架,能自动生成丰富文本上下文,无需专家标注即可引导多标签病灶检测。具体而言,引入无专家双文本提示生成器(DTPG),利用两种互补文本模态:捕捉全局病理模式的语义上下文提示,以及聚焦疾病特异性表现的疾病信标提示。此外,设计双向特征增强器(BFE),协同融合全面诊断上下文与疾病特异性嵌入,显著提升特征表示与检测准确率。在包含多种胸腔疾病类别的两个胸部X光数据集上的大量实验表明,我们的SP-Det框架优于现有先进检测方法,且相比现有可提示架构完全消除对专家标注提示的依赖。
原文摘要 · Abstract (English)
Automated lesion detection in chest X-rays has demonstrated significant potential for improving clinical diagnosis by precisely localizing pathological abnormalities. While recent promptable detection frameworks have achieved remarkable accuracy in target localization, existing methods typically rely on manual annotations as prompts, which are labor-intensive and impractical for clinical applications. To address this limitation, we propose SP-Det, a novel self-prompted detection framework that automatically generates rich textual context to guide multi-label lesion detection without requiring expert annotations. Specifically, we introduce an expert-free dual-text prompt generator (DTPG) that leverages two complementary textual modalities: semantic context prompts that capture global pathological patterns and disease beacon prompts that focus on disease-specific manifestations. Moreover, we devise a bidirectional feature enhancer (BFE) that synergistically integrates comprehensive diagnostic context with disease-specific embeddings to significantly improve feature representation and detection accuracy. Extensive experiments on two chest X-ray datasets with diverse thoracic disease categories demonstrate that our SP-Det framework outperforms state-of-the-art detection methods while completely eliminating the dependency on expert-annotated prompts compared to existing promptable architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。