arXiv:2508.09981cs.CV2025-08AAAI被引 8

提出可插拔的视觉语言模型压缩基准,系统评估多种压缩方法。

LLMC+: Benchmarking Vision-Language Model Compression with a Plug-and-play Toolkit

  • 构建模块化工具包,支持20+压缩算法在5类大模型上的对比实验。
  • 发现空间与时间冗余需不同策略,多轮对话中删减令牌会显著降效。
  • 联合使用令牌与模型压缩可实现极致压缩且损失极小,适合部署优化。

大型视觉语言模型(VLMs)虽具备强大多模态能力,但因长视觉标记序列和巨大参数量导致计算与内存开销巨大。现有训练无关压缩方法存在三大局限:(1) 技术未解耦为可比模块,难以公平评估空间与时间冗余;(2) 评价局限于简单单轮任务,无法反映真实场景表现;(3) 各技术孤立使用,未探索协同潜力。为此,我们提出LLMC+,一个全面的VLM压缩基准及多功能可插拔工具包。该平台支持超过20种算法,覆盖五类代表性VLM,并可系统研究标记级与模型级压缩。实验揭示:(1) 空间与时间冗余需采用不同技术策略;(2) 标记减少方法在多轮对话和细节敏感任务中性能显著下降;(3) 联合使用标记压缩与模型压缩可在极低性能损失下实现超高压缩率。我们认为LLMC+将推动高效VLM研究的公平评估与创新。代码已开源:https://github.com/ModelTC/LightCompress。

原文摘要 · Abstract (English)

Large Vision-Language Models (VLMs) exhibit impressive multi-modal capabilities but suffer from prohibitive computational and memory demands, due to their long visual token sequences and massive parameter sizes. To address these issues, recent works have proposed training-free compression methods. However, existing efforts often suffer from three major limitations: (1) Current approaches do not decompose techniques into comparable modules, hindering fair evaluation across spatial and temporal redundancy. (2) Evaluation confined to simple single-turn tasks, failing to reflect performance in realistic scenarios. (3) Isolated use of individual compression techniques, without exploring their joint potential. To overcome these gaps, we introduce LLMC+, a comprehensive VLM compression benchmark with a versatile, plug-and-play toolkit. LLMC+ supports over 20 algorithms across five representative VLM families and enables systematic study of token-level and model-level compression. Our benchmark reveals that: (1) Spatial and temporal redundancies demand distinct technical strategies. (2) Token reduction methods degrade significantly in multi-turn dialogue and detail-sensitive tasks. (3) Combining token and model compression achieves extreme compression with minimal performance loss. We believe LLMC+ will facilitate fair evaluation and inspire future research in efficient VLM. Our code is available at https://github.com/ModelTC/LightCompress.

模型压缩视觉语言模型可插拔工具多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。