arXiv:2603.11625cs.CVcs.AI2026-03

无需训练的分层剪枝框架,让3D医学视觉模型用少于5%的图像令牌保持高性能。

MedPruner: Training-Free Hierarchical Token Pruning for Efficient 3D Medical Image Understanding in Vision-Language Models

  • 按切片和注意力权重动态剪枝,自动识别冗余信息
  • 在三个数据集上仅用不到5%的视觉令牌仍保持原性能
  • 适合临床部署的高效3D医学多模态模型研究者

尽管专用医学视觉-语言模型在2D和3D医学模态理解中取得显著进展,但其在3D体数据上的部署仍受制于严重的计算效率问题。现有架构因直接拼接连续2D切片而存在大量解剖冗余,且固定剪枝率难以应对不同切片间异质的信息密度。为此,我们提出MedPruner,一种无需训练、与模型无关的分层令牌剪枝框架,专为高效3D医学图像理解设计。该方法包含两阶段机制:基于切片间锚点的过滤模块,消除时间维度冗余;以及动态信息核选择策略,通过累积注意力权重实现自适应的令牌压缩。在三个3D医学基准和三种不同医学VLM上的实验表明,现有架构存在巨大令牌冗余。值得注意的是,MedPruner使MedGemma-1.5等模型在保留少于5%视觉令牌的同时,性能不降反升,显著降低视觉令牌开销,验证了动态令牌选择对实际临床部署的必要性。代码已开源。

原文摘要 · Abstract (English)

While specialized Medical Vision-Language Models (VLMs) have achieved remarkable success in interpreting 2D and 3D medical modalities, their deployment for 3D volumetric data remains constrained by significant computational inefficiencies. Current architectures typically suffer from massive anatomical redundancy due to the direct concatenation of consecutive 2D slices and lack the flexibility to handle heterogeneous information densities across different slices using fixed pruning ratios. To address these challenges, we propose MedPruner, a training-free and model-agnostic hierarchical token pruning framework specifically designed for efficient 3D medical image understanding. MedPruner introduces a two-stage mechanism: an Inter-slice Anchor-based Filtering module to eliminate slice-level temporal redundancy, followed by a Dynamic Information Nucleus Selection strategy that achieves adaptive token-level compression by quantifying cumulative attention weights. Extensive experiments on three 3D medical benchmarks and across three diverse medical VLMs reveal massive token redundancy in existing architectures. Notably, MedPruner enables models such as MedGemma-1.5 to maintain or even exceed their original performance while retaining fewer than 5\% of visual tokens, thereby reducing visual-token overhead and validating the necessity of dynamic token selection for practical clinical deployment. Our code is available at https://github.com/CUHK-AIM-Group/MedPruner.

3D医学图像视觉语言模型令牌剪枝高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。