arXiv:2506.21184cs.CVcs.AI2025-06被引 1

针对长视频理解的计算成本问题,提出动态压缩与选择性重载机制。

Task-Aware KV Compression For Cost-Effective Long Video Understanding

  • 分层压缩关键键值对,保留细节与紧凑表示
  • 在解码阶段仅重载关键片段的高精度信息
  • 无需训练,适配现有模型且显著降耗

长视频理解(LVU)对现有多模态大模型仍构成严峻挑战,主要源于高昂的计算开销。近期方法尝试通过键值(KV)压缩缓解此问题,但高压缩比下常导致严重信息丢失。本文提出 Video-X^2L,可灵活为不同任务保留关键视频信息。该方法包含两项核心操作:一是双层KV压缩,在预填充阶段生成低压缩(L-KVs)与高压缩(H-KVs)两种键值表示,分别捕捉细粒度细节与紧凑表征;二是选择性键值重载,在解码阶段仅对关键视频段落重载L-KVs,其余使用H-KVs,从而兼顾任务相关性与整体紧凑性。Video-X^2L无需额外训练,可直接兼容现有支持KV压缩的多模态大模型。我们在 VideoMME、MLVU、LongVideoBench 与 VNBench 等多个主流长视频理解基准上评估,结果表明其性能显著优于现有压缩方法,同时大幅降低计算成本。

原文摘要 · Abstract (English)

Long-video understanding (LVU) remains a severe challenge for existing multimodal large language models (MLLMs), primarily due to the prohibitive computational cost. Recent approaches have explored KV compression to mitigate this issue, but they often suffer from significant information loss at high compression ratios. In this paper, we introduce Video-X^2L, which flexibly preserves critical video information for each LVU task. Video-X^2L involves two key operations. The first one is called bi-level KV compression. During the MLLM's pre-filling stage, Video-X^2L generates two types of compressed KVs: low-compression KVs (L-KVs) to capture fine-grained video details and high-compression KVs (H-KVs) to offer compact video representations. The second one is called selective KV re-loading. During the MLLM's decoding stage, Video-X^2L selectively re-loads L-KVs for the most critical video chunks while using H-KVs for other less important ones. This allows the MLLM to fully utilize task-specific information while maintaining the overall compactness. Video-X^2L is simple yet effective: it is free from additional training and directly compatible with existing KV-compressible MLLMs. We evaluate Video-X^2L with a variety of popular LVU benchmarks, including VideoMME, MLVU, LongVideoBench, and VNBench. Our experiment result shows that Video-X^2L outperforms existing KV-compression methods by a huge advantage while substantially saving the computation cost.

长视频理解键值压缩多模态模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。