arXiv:2608.11458cs.CV2026-08

用多智能体验证视频目标是否存在,精准识别误导性描述。

Multi-Agent Target-Existence Verification and Learned Mask Geometry Refinement: Winning Report of the MeViS-Text Track at the 8th LSVOS Challenge 2026

论文配图:Multi-Agent Target-Existence Verification and Learned Mask Geometry Refinement: Winning Report of the MeViS-Text Track at the 8th LSVOS Challenge 2026
图 1 · 摘自论文原文
  • 三模型独立推理后合成决策,提升语义理解准确性。
  • 分离存在性验证,纠正因相机运动导致的误判,准确率显著提升。
  • 仅用训练数据优化掩码风格,不改变语义判断,适合高精度场景应用。

我们提出首个在2026年第八届大规模视频对象分割(LSVOS)挑战赛MeViS-Text赛道中获奖的解决方案:基于文本运动描述进行视频对象分割,包含不指向任何实际物体的误导性无目标表达,需在所有帧中输出空掩码。我们的SSUPER系统将每个表达解析为视觉概念,利用SAM~3.1生成全视频候选掩码,再选择目标ID。每个推理阶段由三个异构多模态大语言模型独立执行特定提示,最后通过一次合成步骤提交经结构验证的结论。尽管该系统在验证集上成功拒绝所有无目标表达,但排行榜显示测试集中仍有大量无目标案例漏检。原因是难负样本虽命名合理物体,但在完整时序谓词下才失效,当选择与存在性合并判断时,类别合理的掩码会锚定错误结论。因此,我们将其存在性验证解耦为独立的多智能体审计,全面检查类别、数量、动作、轨迹、事件顺序和语义角色等属性,区分缺失与暂时不可见,排除相机移动引起的假运动,并要求矛盾证据而非仅不确定性才能判定无目标。此审计无需新增分割调用,即可修复大部分残余无目标错误。随后,仅使用训练数据的StyleRefiner将掩码几何对齐至MeViSv2标注风格,同时保留所有存在性判断,证明剩余误差部分源于风格而非语义。最终系统在官方排行榜获得0.9081339614的分数。

原文摘要 · Abstract (English)

We present the first-place solution to the MeViS-Text track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge 2026: referring video object segmentation guided by written motion expressions, including deceptive no-target expressions that match no object in the video and must yield empty masks in every frame. Our pipeline, SSUPER, resolves each expression into a visual concept, generates full-video candidate masklets with SAM~3.1, and selects target IDs. At every reasoning stage, three heterogeneous multimodal large language models independently execute the same stage-specific prompt before a single synthesis pass commits one schema-validated verdict. Although this system rejects every no-target expression in validation, the leaderboard reveals that a substantial share of test no-target cases still slips through. The reason is that hard negatives name a plausible object and fail only under the complete temporal predicate, so when selection and existence are decided together, a category-plausible masklet anchors the verdict. Hence, we decouple existence verification into an independent multi-agent audit of the full predicate (category, count, action, trajectory, event order, and semantic role) that distinguishes absence from temporary invisibility, discounts apparent motion caused by camera movement, and requires contradicting evidence rather than mere uncertainty for a no-target verdict. Without any new segmentation call, this audit recovers most of the residual no-target errors. A training-data-only StyleRefiner then aligns mask geometry with the annotation style of MeViSv2 while preserving every presence decision by construction, showing that once the semantics are fixed, part of the remaining error is stylistic rather than semantic. The complete system reaches a Final score of 0.9081339614 on the official challenge leaderboard.

视频分割多智能体语义验证风格对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。