arXiv:2604.22546cs.CV2026-04

解决开放词汇场景图生成中关系缺失问题,提升罕见和未知关系识别能力。

ReLIC-SGG: Relation Lattice Completion for Open-Vocabulary Scene Graph Generation

论文配图:ReLIC-SGG: Relation Lattice Completion for Open-Vocabulary Scene Graph Generation
图 1 · 摘自论文原文
  • 将未标注关系视为潜在变量,构建语义关系网格建模词语间逻辑关系。
  • 在多个基准上显著提升罕见与未见谓词识别准确率,有效恢复遗漏关系。
  • 适合需要高精度开放词汇场景理解的视觉推理任务,如智能导航、内容生成。

开放词汇场景图生成(SGG)旨在用灵活的关系短语描述视觉场景,突破固定谓词集的限制。现有方法通常将标注三元组视为正例,所有未标注的对象对关系视为负例。然而,场景图标注本质上不完整:许多有效关系缺失,同一交互可不同粒度描述,如‘on’、‘standing on’、‘resting on’、‘supported by’。这一问题在开放词汇SGG中尤为严重,因关系空间大幅扩大。本文提出ReLIC-SGG,一种关系不完整性感知框架,将未标注关系视为潜在变量而非确定负例。该框架构建语义关系网格,建模开放词汇谓词间的相似性、蕴含与矛盾关系,并利用其从视觉-语言一致性、图上下文和语义一致性中推断缺失正例。引入正-未标记图学习目标减少假负样本监督,网格引导解码生成紧凑且语义一致的场景图。在常规、开放词汇及全景SGG基准上的实验表明,ReLIC-SGG显著提升罕见与未见谓词识别能力,更有效地恢复缺失关系。

原文摘要 · Abstract (English)

Open-vocabulary scene graph generation (SGG) aims to describe visual scenes with flexible relation phrases beyond a fixed predicate set. Existing methods usually treat annotated triplets as positives and all unannotated object-pair relations as negatives. However, scene graph annotations are inherently incomplete: many valid relations are missing, and the same interaction can be described at different granularities, e.g., \textit{on}, \textit{standing on}, \textit{resting on}, and \textit{supported by}. This issue becomes more severe in open-vocabulary SGG due to the much larger relation space. We propose \textbf{ReLIC-SGG}, a relation-incompleteness-aware framework that treats unannotated relations as latent variables rather than definite negatives. ReLIC-SGG builds a semantic relation lattice to model similarity, entailment, and contradiction among open-vocabulary predicates, and uses it to infer missing positive relations from visual-language compatibility, graph context, and semantic consistency. A positive-unlabeled graph learning objective further reduces false-negative supervision, while lattice-guided decoding produces compact and semantically consistent scene graphs. Experiments on conventional, open-vocabulary, and panoptic SGG benchmarks show that ReLIC-SGG improves rare and unseen predicate recognition and better recovers missing relations.

场景图生成开放词汇关系推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。