arXiv:2512.20936cs.CV2025-12被引 1

通过协作智能体分步推理,实现更准确的物体隐性部分补全。

Reasoning-Driven Amodal Completion: Collaborative Agents and Perceptual Evaluation

  • 先用专门智能体规划语义结构,再生成图像,避免错误累积。
  • 在多个数据集上超越现有方法,尤其在结构完整性和语义一致性上提升显著。
  • 适合研究视觉推理、生成模型或需要高精度补全的应用场景。

隐性补全任务旨在推断被遮挡的物体部分,但常面临语义一致性和结构完整性难题。现有渐进式方法因推理不稳定和误差积累而受限。为此,我们提出协同多智能体推理框架,将语义规划与视觉合成显式分离。通过前置推理智能体生成结构化、明确的计划,实现单次生成即可获得视觉与语义一致的结果。框架集成两项关键机制:(1) 自校正验证智能体,在语义规划阶段利用思维链推理修正可见区域分割并识别残留遮挡物;(2) 多样化假设生成器,通过提供多种合理语义解释解决不可见区域的歧义问题,优于传统随机种子采样的像素级差异。此外,针对传统评估指标对隐性内容评估不足的问题,我们提出新度量标准MAC-Score(MLLM Amodal Completion Score),该指标经人类判断与真实标注验证,可有效评估结构完整性与语义一致性。大量实验表明,本方法在多个数据集上显著优于当前最优方法。项目地址:https://fanhongxing.github.io/remac-page。

原文摘要 · Abstract (English)

Amodal completion, the task of inferring invisible object parts, faces significant challenges in maintaining semantic consistency and structural integrity. Prior progressive approaches are inherently limited by inference instability and error accumulation. To tackle these limitations, we present a Collaborative Multi-Agent Reasoning Framework that explicitly decouples Semantic Planning from Visual Synthesis. By employing specialized agents for upfront reasoning, our method generates a structured, explicit plan before pixel generation, enabling visually and semantically coherent single-pass synthesis. We integrate this framework with two critical mechanisms: (1) a self-correcting Verification Agent that employs Chain-of-Thought reasoning to rectify visible region segmentation and identify residual occluders strictly within the Semantic Planning phase, and (2) a Diverse Hypothesis Generator that addresses the ambiguity of invisible regions by offering diverse, plausible semantic interpretations, surpassing the limited pixel-level variations of standard random seed sampling. Furthermore, addressing the limitations of traditional metrics in assessing inferred invisible content, we introduce the MAC-Score (MLLM Amodal Completion Score), a novel human-aligned evaluation metric. Validated against human judgment and ground truth, these metrics establish a robust standard for assessing structural completeness and semantic consistency with visible context. Extensive experiments demonstrate that our framework significantly outperforms state-of-the-art methods across multiple datasets. Our project is available at: https://fanhongxing.github.io/remac-page.

隐性补全多智能体生成评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。