arXiv:2503.18862cs.CVcs.AI2025-03

用键值注意力提升分割模型效率,医疗图像适用。

Exploring the Integration of Key-Value Attention Into Pure and Hybrid Transformers for Semantic Segmentation

  • 用键值注意力替代传统注意力,降低计算开销。
  • 参数量和乘加操作减少,分割精度基本不变。
  • 适合本地部署的医疗影像分析场景。

尽管卷积神经网络长期被视为图像处理的主流方法,但变压器架构的出现已对其地位构成挑战。尽管在图像分类与分割任务中表现优异,现有变压器仍高度依赖大规模训练数据且计算成本高昂。新提出的键值变压器(KV Transformer)在合成数据、自然语言处理及图像分类任务中展现出良好效果,同时降低了复杂度与内存消耗,尤其适用于需要本地推理的场景,如医疗筛查。本文旨在进一步评估键值变压器在语义分割任务中的表现,特别是在医学影像领域。通过直接对比相同基础架构的传统版本与键值变体,我们深入探讨了模型复杂度降低带来的实际权衡。结果显示,键值变体在参数量和乘加操作数上显著减少,而多数模型在直接对比中仍保持相近的性能水平。

原文摘要 · Abstract (English)

While CNNs were long considered state of the art for image processing, the introduction of Transformer architectures has challenged this position. While achieving excellent results in image classification and segmentation, Transformers remain inherently reliant on large training datasets and remain computationally expensive. A newly introduced Transformer derivative named KV Transformer shows promising results in synthetic, NLP, and image classification tasks, while reducing complexity and memory usage. This is especially conducive to use cases where local inference is required, such as medical screening applications. We endeavoured to further evaluate the merit of KV Transformers on semantic segmentation tasks, specifically in the domain of medical imaging. By directly comparing traditional and KV variants of the same base architectures, we provide further insight into the practical tradeoffs of reduced model complexity. We observe a notable reduction in parameter count and multiply accumulate operations, while achieving similar performance from most of the KV variant models when directly compared to their QKV implementation.

图像分割键值注意力医疗影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。