提出双向解码交互机制,提升乳腺超声图像分割与分类的准确性。
Multi-Level Bidirectional Decoder Interaction for Uncertainty-Aware Breast Ultrasound Analysis
- 多层级解码器间双向通信,融合语义与空间信息。
- 基于激活方差自适应加权,实现每样本任务平衡,达74.5%分割IoU。
- 适合需要高精度医学影像分析的研究者使用。
乳腺超声解读需同时完成病灶分割与组织分类。传统多任务学习方法存在任务干扰和固定协调策略,难以适应不同实例的预测难度。本文提出一种多任务框架,通过多层级解码器交互与不确定性感知的自适应协调来解决上述问题。各解码层级均设置任务交互模块,利用注意力加权池化与乘性调制实现分割与分类间的双向通信,捕获从语义到空间尺度的任务协同效应,生成互补的任务交互流。不确定性代理注意力根据特征激活方差动态调整各层级基础与增强特征权重,实现无需人工调参的层级与样本级任务平衡。多尺度上下文融合捕捉不同大小病灶的形态线索。在多个公开乳腺超声数据集上评估显示,该方法表现优异,在BUSI数据集上达到74.5%的病灶分割交并比(IoU)和90.6%的分类准确率。消融实验验证了多层级任务交互的显著增益,证明解码器级双向通信优于传统编码器级参数共享。代码已开源:https://github.com/C-loud-Nine/Uncertainty-Aware-Multi-Level-Decoder-Interaction。
原文摘要 · Abstract (English)
Breast ultrasound interpretation requires simultaneous lesion segmentation and tissue classification. However, conventional multi-task learning approaches suffer from task interference and rigid coordination strategies that fail to adapt to instance-specific prediction difficulty. We propose a multi-task framework addressing these limitations through multi-level decoder interaction and uncertainty-aware adaptive coordination. Task Interaction Modules operate at all decoder levels, establishing bidirectional segmentation-classification communication during spatial reconstruction through attention weighted pooling and multiplicative modulation. Unlike prior single-level or encoder-only approaches, this multi-level design captures scale specific task synergies across semantic-to-spatial scales, producing complementary task interaction streams. Uncertainty-Proxy Attention adaptively weights base versus enhanced features at each level using feature activation variance, enabling per-level and per-sample task balancing without heuristic tuning. To support instance-adaptive prediction, multi-scale context fusion captures morphological cues across varying lesion sizes. Evaluation on multiple publicly available breast ultrasound datasets demonstrates competitive performance, including 74.5% lesion IoU and 90.6% classification accuracy on BUSI dataset. Ablation studies confirm that multi-level task interaction provides significant performance gains, validating that decoder-level bidirectional communication is more effective than conventional encoder-only parameter sharing. The code is available at: https://github.com/C-loud-Nine/Uncertainty-Aware-Multi-Level-Decoder-Interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。