无需训练,分两步实现精准视频检索生成。
Decoupling Semantics and Logic: A Training-Free Coarse-to-Fine Pipeline for Video Retrieval-Augmented Generation

- 先用视觉摘要和文本描述做高召回语义预取,过滤噪声模态。
- 再用大模型进行逻辑推理重排,确保生成内容与用户角色一致。
- 生成结果带精确片段引用,零幻觉且格式规范,适合严格场景。
本文针对跨语言长视频理解、严格角色一致性及零幻觉时间定位等挑战,提出一种完全无需训练的两级级联视频RAG流水线。第一阶段采用密集检索技术,仅使用高保真视觉摘要和全局文本描述进行高召回语义预取,并显式隔离噪声模态(如OCR、ASR),以维护纯净向量空间。第二阶段由基于商用大语言模型的自适应、迭代式推理(A.I.R.)过滤代理执行细粒度认知重排序,重新引入全模态上下文,强制与用户角色保持逻辑一致,有效剔除语义相似但逻辑无关的候选项。最后通过提示塑造机制,将提炼后的子集约束为带精确块级引用的结构化JSON输出。在RAG赛道评估中,该资源感知方法在信息检索与角色引导生成方面均表现出卓越精度。
原文摘要 · Abstract (English)
This paper presents our system description for the 2nd Workshop on Multimodal Augmented Generation via MultimodAl Retrieval (MAGMaR). Addressing the critical challenges of cross-lingual long-video comprehension, strict persona adherence, and zero-hallucination temporal grounding, we propose a fully training-free, two-stage cascaded Video RAG pipeline. Our architecture strategically decouples semantic retrieval from cognitive logical reasoning through a modality-aware division of labor. In the first stage, a high-recall semantic pre-fetching module employs dense retrieval using only high-fidelity visual summaries and global text descriptions, explicitly isolating noisy modalities (e.g., OCR and ASR) to maintain a pristine vector space. In the second stage, an Adaptive, Iterative, and Reasoning-based (A.I.R.) filtering agent, powered by a commercial Large Language Model (LLM), performs fine-grained cognitive reranking. The agent re-incorporates full multimodal contexts to enforce strict logical alignment with user personas, effectively pruning semantically similar but logically irrelevant candidates. Finally, a Prompt Sculpting mechanism constrains the generator to synthesize the distilled subset into strictly formatted JSON responses with exact chunk-level citations. Evaluated on the RAG track, our resource-aware approach shows exceptional precision in both information retrieval and persona-conditioned generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。