arXiv:2608.23011cs.CVcs.AI2026-08

让长视频检索分两步走:粗略定位,精细回答。

Coarse Indexing, Fine Evidence: Decoupling Temporal Granularity in Long-Video RAG

论文配图:Coarse Indexing, Fine Evidence: Decoupling Temporal Granularity in Long-Video RAG
图 1 · 摘自论文原文
  • 用视觉冗余合并法构建紧凑的粗粒度索引图
  • 节点减少40%-50%,推理速度提升1.3-1.7倍,性能损失<1%
  • 不依赖训练,适配多种模型和视频检索系统

基于图的检索增强生成(RAG)为长视频理解提供了可扩展的范式,但现有系统在构建检索索引时通常沿用视频分割的固定时间粒度。我们提出无需训练的密度自适应图构建(DAGC)方法,将查询无关的粗粒度索引与原始细粒度证据空间解耦。DAGC通过合并视觉冗余的相邻片段,构建紧凑且自适应密度的图索引,同时保留对原始时间单元的映射关系。检索到的粗粒度区域随后回溯至原始块粒度,用于细粒度证据精炼与答案生成。在MLVU、VideoMME和LongVideoBench上的实验表明,DAGC仅保留原图约40%-50%的节点,实现1.3-1.7倍的端到端墙钟加速,同时保持约99%的原始问答性能。该效果在不同长视频视觉语言模型(LVLM)骨干网络和视频RAG流水线间具有迁移性,说明长视频RAG无需在索引与推理阶段保持相同时间粒度。

原文摘要 · Abstract (English)

Graph-based retrieval-augmented generation (RAG) provides a scalable paradigm for long-video understanding, but existing systems typically inherit a fixed temporal granularity from video segmentation when constructing their retrieval index. We argue that this design unnecessarily couples indexing granularity with evidence granularity: coarse representations can often suffice for locating relevant temporal regions, while fine-grained evidence remains important for downstream reasoning. We propose \textbf{Density-Aware Graph Construction (DAGC)}, a training-free approach that decouples a query-independent coarse retrieval index from the original fine-grained evidence space. DAGC constructs a compact, density-adaptive graph index by merging visually redundant neighboring chunks, while preserving mappings to the original temporal units. Retrieved coarse regions are subsequently expanded back to the original chunk granularity for fine-grained evidence refinement and answer generation. Experiments on MLVU, VideoMME, and LongVideoBench show that DAGC retains only about 40--50\% of the original graph nodes and achieves $1.3$--$1.7\times$ end-to-end wall-clock acceleration while preserving approximately 99\% of the original QA performance. The gains transfer across different LVLM backbones and video RAG pipelines, suggesting that long-video RAG need not maintain the same temporal granularity for indexing and evidence reasoning.

长视频理解检索增强图结构粒度解耦

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。