用注意力引导全局与局部特征融合,提升病灶图像分类准确率
An Attention-Guided Global and Local Fusion Framework for Lesion-Focused Image Classification

- 通过注意力图生成聚焦区域,分别提取全局上下文和局部病灶特征
- 在皮肤病变数据集上达97.75%准确率,瓜叶数据集达99.64%
- 适合医疗影像分析场景,增强模型可解释性与决策可靠性
病灶聚焦图像分类面临关键挑战:判别信号稀疏、空间分散且易被背景噪声掩盖,而传统卷积神经网络(CNN)对全图统一处理,可能稀释信号相关性。本研究假设自适应融合全局上下文信息与病灶聚焦局部信息,优于单独使用任一表征。提出基于DenseNet-121的三分支注意力引导深度学习框架,以提升特征归因、可解释性与分类可靠性。架构包括:全局分支学习整图表示,经梯度加权类激活映射(Grad-CAM)生成注意力图并生成掩码输入;局部分支引入卷积块注意力模块(CBAM),从聚焦区域提取细化的空间与通道特征;自适应融合分支通过学习实例特定权重,动态整合全局与局部表示。在合成斑点模式数据集(SSPD)及皮肤病变、木瓜叶、葡萄叶三个基准数据集上评估,融合分支表现优于单一分支,在皮肤病变数据集达到97.75%准确率,木瓜叶数据集达99.64%。
原文摘要 · Abstract (English)
Lesion-focused image classification presents a core analytical challenge, as discriminative signals are often sparse, spatially dispersed, and easily obscured by background noise, while conventional convolutional neural networks (CNNs) process entire images uniformly and may dilute signal relevance. This study hypothesizes that adaptive fusion of global contextual information and lesion-focused local information can improve classification performance compared with using either representation independently. We propose a three-branch, attention-guided deep learning framework built on Densely Connected Convolutional Network-121 (DenseNet-121) to improve feature attribution, interpretability, and classification reliability. The architecture consists of a global branch that learns representations from full images, followed by Gradient-weighted Class Activation Mapping (Grad-CAM) to generate attention maps that highlight prediction-relevant regions and produce masked inputs, and a local branch enhanced with a Convolutional Block Attention Module (CBAM) to extract refined spatial and channel-wise features from these focused regions. An adaptive fusion branch integrates global and local representations by learning instance-specific weights, allowing dynamic prioritization between contextual and localized information. The framework is evaluated on a synthetic Spot Pattern Dataset (SSPD) and three benchmark datasets, including skin lesion, guava leaf, and grape leaf image datasets, where the fusion branch outperformed the individual global and local branches, reaching 97.75% accuracy on the skin lesion dataset and 99.64% on the guava leaf dataset. The results highlight the value of attention-guided architectures in healthcare analytics by improving model transparency, strengthening feature relevance, and supporting more reliable data-driven decision-making in medical image analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。