用多智能体协作推理实现高效精准视频检索
MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding

- 将视频解析为结构化语义库,按属性层级索引
- 通过任务分解与逻辑辩论机制,精准筛选候选视频
- 无需微调即可在多个数据集上表现优异
当前视频检索主流方法依赖嵌入式全库扫描,存在计算效率低和视频信息密集性与文本查询稀疏性不匹配的问题。为此,我们提出全新的多智能体框架MAVIS,将检索重构为协作推理过程而非暴力搜索。MAVIS首先通过解析原始视频构建结构化语义库,实现属性级显式索引。检索时,规划器将复杂用户意图拆解为原子子任务,调度专用智能体独立提名候选视频。关键在于,MAVIS采用逻辑感知辩论机制与严格否决协议,各智能体协同排除逻辑不符项,筛选出少量‘有争议’候选视频进行细粒度验证。该代理工作流有效规避了全库遍历的低效问题。在MSR-VTT、MSVD和ActivityNet上的大量实验表明,MAVIS无需任务特定微调即达到竞争性性能,为传统双编码器方法提供可扩展且可解释的替代方案。
原文摘要 · Abstract (English)
The dominant paradigm in video retrieval relies on embedding-based full-corpus scanning, which suffers from inherent computational inefficiency and the semantic asymmetry between information-dense videos and sparse textual queries. To bridge this gap, we introduce \textbf{MAVIS}, a novel multi-agent framework that rethinks retrieval as cooperative reasoning rather than brute-force search. MAVIS first bridges the granularity mismatch by parsing raw videos into a \textbf{Structured Semantic Library}, enabling explicit attribute-level indexing. During retrieval, a planner decomposes complex user intents into atomic sub-tasks, dispatching specialized agents to independently nominate candidates. Crucially, MAVIS employs a \textbf{Logic-aware Debate} mechanism with a strict veto protocol, where agents collaboratively prune logical mismatches to identify a compact set of ``controversial'' candidates for fine-grained verification. This agentic workflow effectively bypasses the inefficiency of full-library traversal. Extensive experiments on MSR-VTT, MSVD, and ActivityNet demonstrate that MAVIS achieves competitive performance without task-specific fine-tuning, offering a scalable and interpretable alternative to traditional dual-encoder approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。