提出新型关系推理框架,提升3D场景图中关系预测准确性。
Edge-Centric Relational Reasoning for 3D Scene Graph Prediction
- 以关系为中心构建线图,捕捉多对象间复杂依赖
- 在3DSSG数据集上显著优于现有方法
- 适用于各类现有3D场景图模型,通用性强
3D场景图预测旨在将复杂三维环境抽象为包含物体及其成对关系的结构化图。现有方法多采用以物体为中心的图神经网络,通过聚合相连物体节点的信息迭代更新关系边特征。但该设计使关系表示受限于成对物体上下文,难以捕捉对准确关系预测至关重要的高阶关系依赖。为此,本文提出一种基于链接引导的边中心关系推理框架(LEO),实现从关系级上下文到物体级理解的渐进式推理。具体而言,LEO首先预测物体对间的潜在连接以抑制无关边,随后将原始场景图转换为线图,将每条关系视为节点。在线图上应用图神经网络进行边中心关系推理,捕获关系间上下文信息。增强后的关系特征再融合回原物体中心图,提升物体级推理能力并改善关系预测。本框架具备模型无关性,可与任意现有物体中心方法集成。在3DSSG数据集上的实验显示,相比两个基准方法,均取得一致性能提升,验证了边到物体推理范式的有效性。
原文摘要 · Abstract (English)
3D scene graph prediction aims to abstract complex 3D environments into structured graphs consisting of objects and their pairwise relationships. Existing approaches typically adopt object-centric graph neural networks, where relation edge features are iteratively updated by aggregating messages from connected object nodes. However, this design inherently restricts relation representations to pairwise object context, making it difficult to capture high-order relational dependencies that are essential for accurate relation prediction. To address this limitation, we propose a Link-guided Edge-centric relational reasoning framework with Object-aware fusion, namely LEO, which enables progressive reasoning from relation-level context to object-level understanding. Specifically, LEO first predicts potential links between object pairs to suppress irrelevant edges, and then transforms the original scene graph into a line graph where each relation is treated as a node. A line graph neural network is applied to perform edge-centric relational reasoning to capture inter-relation context. The enriched relation features are subsequently integrated into the original object-centric graph to enhance object-level reasoning and improve relation prediction. Our framework is model-agnostic and can be integrated with any existing object-centric method. Experiments on the 3DSSG dataset with two competitive baselines show consistent improvements, highlighting the effectiveness of our edge-to-object reasoning paradigm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。