arXiv:2604.20136cs.CVcs.AI2026-04被引 1

用多智能体系统实现视频语义记忆的逐条修正,降低纠错成本。

IMPACT-CYCLE: A Contract-Based Multi-Agent System for Claim-Level Supervisory Correction of Long-Video Semantic Memory

论文配图:IMPACT-CYCLE: A Contract-Based Multi-Agent System for Claim-Level Supervisory Correction of Long-Video Semantic Memory
图 1 · 摘自论文原文
  • 构建角色分工的智能体合约系统,分步验证视频语义关系
  • 在VidOR数据集上使问答准确率从0.71提升至0.79
  • 人类干预成本降低4.8倍,适合需高精度视频理解的场景

长视频理解中的错误修正代价高昂:现有多模态流程输出黑箱、端到端结果,无法提供中间状态供检查,迫使标注者重看原始视频并重建时间逻辑。核心瓶颈不仅是生成质量,更是缺乏一种监督接口,使人工投入与错误范围成比例。本文提出IMPACT-CYCLE,一个基于合约的多智能体监督系统,将长视频理解重构为对共享语义记忆的迭代性逐条维护——该记忆结构包含带类型声明、依赖图和溯源日志的版本化状态。角色专精的智能体在明确权限契约下,分解验证任务为局部对象-关系正确性、跨时序一致性与全局语义连贯性,且仅对结构相关声明进行修正。当自动证据不足时,系统升级至人类仲裁作为最终裁决权威;依赖闭包重验证确保修正成本与错误范围成比例。在VidOR数据集上的实验显示,下游推理性能显著提升(VQA:0.71 → 0.79),人类仲裁成本降低4.8倍,工作量远低于手动标注。代码将发布于https://github.com/MKong17/IMPACT_CYCLE。

原文摘要 · Abstract (English)

Correcting errors in long-video understanding is disproportionately costly: existing multimodal pipelines produce opaque, end-to-end outputs that expose no intermediate state for inspection, forcing annotators to revisit raw video and reconstruct temporal logic from scratch. The core bottleneck is not generation quality alone, but the absence of a supervisory interface through which human effort can be proportional to the scope of each error. We present IMPACT-CYCLE, a supervisory multi-agent system that reformulates long-video understanding as iterative claim-level maintenance of a shared semantic memory -- a structured, versioned state encoding typed claims, a claim dependency graph, and a provenance log. Role-specialized agents operating under explicit authority contracts decompose verification into local object-relation correctness, cross-temporal consistency, and global semantic coherence, with corrections confined to structurally dependent claims. When automated evidence is insufficient, the system escalates to human arbitration as the supervisory authority with final override rights; dependency-closure re-verification then ensures correction cost remains proportional to error scope. Experiments on VidOR show substantially improved downstream reasoning (VQA: 0.71 to 0.79) and a 4.8x reduction in human arbitration cost, with workload significantly lower than manual annotation. Code will be released at https://github.com/MKong17/IMPACT_CYCLE.

视频理解多智能体语义记忆纠错系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。