arXiv:2409.00694cs.CV2024-09被引 1

通过层内与跨层交互增强,提升小病灶和边界模糊病灶的检测效果。

IAFI-FCOS: Intra- and across-layer feature interaction FCOS model for lesion detection of CT images

  • 引入上下文增强与跨层加权模块,融合多尺度特征信息
  • 在胰腺病灶数据集上达到当前最优性能
  • 适合早期微小病灶检测任务,尤其关注医学影像细节

医学图像中有效病灶检测不仅依赖病灶区域特征,还与周围环境信息密切相关。然而,现有方法尚未充分挖掘此类上下文信息。此外,传统检测器的多尺度特征融合机制难以无损传递细节信息,导致早期疾病中微小及边界模糊病灶难以检测。为此,本文提出一种新型的层内与跨层特征交互FCOS模型(IAFI-FCOS),其核心为多尺度特征融合结构ICAF-FPN,包含层内上下文增强(ICA)块与跨层特征加权(AFW)块。ICA块利用空洞注意力机制增强局部上下文信息,捕捉病灶区域与周边的长程依赖关系;AFW块采用双轴注意力与加权操作,实现高效跨层特征交互,强化细节特征表达。本方法在自建胰腺病灶数据集与公开的DeepLesion数据集上进行了广泛实验,结果表明在胰腺病灶数据集上达到当前最优(SOTA)表现。

原文摘要 · Abstract (English)

Effective lesion detection in medical image is not only rely on the features of lesion region,but also deeply relative to the surrounding information.However,most current methods have not fully utilize it.What is more,multi-scale feature fusion mechanism of most traditional detectors are unable to transmit detail information without loss,which makes it hard to detect small and boundary ambiguous lesion in early stage disease.To address the above issues,we propose a novel intra- and across-layer feature interaction FCOS model (IAFI-FCOS) with a multi-scale feature fusion mechanism ICAF-FPN,which is a network structure with intra-layer context augmentation (ICA) block and across-layer feature weighting (AFW) block.Therefore,the traditional FCOS detector is optimized by enriching the feature representation from two perspectives.Specifically,the ICA block utilizes dilated attention to augment the context information in order to capture long-range dependencies between the lesion region and the surrounding.The AFW block utilizes dual-axis attention mechanism and weighting operation to obtain the efficient across-layer interaction features,enhancing the representation of detailed features.Our approach has been extensively experimented on both the private pancreatic lesion dataset and the public DeepLesion dataset,our model achieves SOTA results on the pancreatic lesion dataset.

病灶检测医学图像特征融合FCOS

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。