用临床推理思维提升医学影像分割,小病灶识别更准。
MedSeg-R: Medical Image Segmentation with Clinical Reasoning
- 分两阶段:先从报告提取位置纹理形状等语义先验,再引导分割
- 在重叠模糊结构上Dice得分显著提升,小病灶敏感性大幅增强
- 轻量级设计,可直接接入SAM系统,适合医学影像细分场景
医学图像分割因解剖结构重叠、边界模糊及前景与背景严重不平衡而困难,尤其影响小病灶的勾画。现有方法如编码器-解码器网络和基于提示的Segment Anything Model(SAM)变体主要依赖局部线索或用户提示,缺乏整合的语义先验,难以泛化至低对比度或重叠目标。为此,我们提出MedSeg-R,一种受临床推理启发的轻量级双阶段框架。其认知阶段将医学报告解析为结构化的语义先验(位置、纹理、形状),通过Transformer模块融合;感知阶段则利用这些先验调制SAM主干:空间注意力突出可能病变区域,动态卷积根据预期纹理自适应特征滤波,可变形采样优化空间支持。通过早期嵌入细粒度引导,MedSeg-R有效分离类别混淆并增强少数类信号,显著提升对小病灶的敏感性。在多个挑战性基准测试中,该模型在重叠与模糊结构上的Dice分数大幅提升,证明了其与SAM系系统良好的即插即用兼容性。
原文摘要 · Abstract (English)
Medical image segmentation is challenging due to overlapping anatomies with ambiguous boundaries and a severe imbalance between the foreground and background classes, which particularly affects the delineation of small lesions. Existing methods, including encoder-decoder networks and prompt-driven variants of the Segment Anything Model (SAM), rely heavily on local cues or user prompts and lack integrated semantic priors, thus failing to generalize well to low-contrast or overlapping targets. To address these issues, we propose MedSeg-R, a lightweight, dual-stage framework inspired by inspired by clinical reasoning. Its cognitive stage interprets medical report into structured semantic priors (location, texture, shape), which are fused via transformer block. In the perceptual stage, these priors modulate the SAM backbone: spatial attention highlights likely lesion regions, dynamic convolution adapts feature filters to expected textures, and deformable sampling refines spatial support. By embedding this fine-grained guidance early, MedSeg-R disentangles inter-class confusion and amplifies minority-class cues, greatly improving sensitivity to small lesions. In challenging benchmarks, MedSeg-R produces large Dice improvements in overlapping and ambiguous structures, demonstrating plug-and-play compatibility with SAM-based systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。