提出多尺度特征增强的医学图像多任务模型,提升分割与分类性能。
Multi-scale Feature Enhancement in Multi-task Learning for Medical Image Analysis
- 用改进的ResFormer块融合局部细节与长程依赖,增强特征表达。
- 多尺度特征融合使分类准确率提升,不同尺寸病灶检测更精准。
- 适合需要同时做分割与分类的医学影像分析场景。
传统深度学习方法在医学图像中通常只关注分割或分类,难以利用共享信息。多任务学习(MTL)通过共享表示结合两类任务,但常因难以平衡分割所需的局部空间特征与分类所需的全局语义特征,导致性能不佳。本文提出一种基于UNet的简单而有效的MTL模型:编码器提取的特征用于预测分类标签,解码器生成分割掩码。模型引入新型ResFormer块,融合卷积提取的局部上下文与Transformer建模的长程依赖,捕捉更广泛的上下文关系和精细细节。为提升分类性能,将编码器多层输出的多尺度特征进行融合,利用图像的层次化表示。针对分割任务,通过跳跃连接传递至解码器的特征,经由新颖的空洞特征增强(DFE)模块进行优化,该模块采用三个不同膨胀率的并行卷积分支,捕获多尺度信息,从而更准确识别不同大小的病灶。在多个医学数据集上的实验结果表明,本模型在分割与分类任务上均优于现有单任务及多任务学习方法。
原文摘要 · Abstract (English)
Traditional deep learning methods in medical imaging often focus solely on segmentation or classification, limiting their ability to leverage shared information. Multi-task learning (MTL) addresses this by combining both tasks through shared representations but often struggles to balance local spatial features for segmentation and global semantic features for classification, leading to suboptimal performance. In this paper, we propose a simple yet effective UNet-based MTL model, where features extracted by the encoder are used to predict classification labels, while the decoder produces the segmentation mask. The model introduces an advanced encoder incorporating a novel ResFormer block that integrates local context from convolutional feature extraction with long-range dependencies modeled by the Transformer. This design captures broader contextual relationships and fine-grained details, improving classification and segmentation accuracy. To enhance classification performance, multi-scale features from different encoder levels are combined to leverage the hierarchical representation of the input image. For segmentation, the features passed to the decoder via skip connections are refined using a novel dilated feature enhancement (DFE) module, which captures information at different scales through three parallel convolution branches with varying dilation rates. This allows the decoder to detect lesions of varying sizes with greater accuracy. Experimental results across multiple medical datasets confirm the superior performance of our model in both segmentation and classification tasks, compared to state-of-the-art single-task and multi-task learning methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。