arXiv:2603.28178cs.CV2026-03

通过拓扑布局学习,解决3D场景图生成中的几何捷径问题。

ToLL: Topological Layout Learning with Asymmetric Cross-View Structural Distillation for 3D Scene Graph Generation Pretraining

  • 用锚点引导的递归GNN恢复无可见空间特征的全局布局。
  • 在特殊数据集上优于当前最佳基线,提升场景图预训练质量。
  • 适合做3D空间理解与场景生成的研究者参考。

3D场景图(3DSG)生成在空间理解与功能感知中至关重要。为缓解数据稀缺导致的泛化问题,现有方法在无谓词标签数据集上采用联合嵌入与生成代理任务进行3DSG表征预训练。当前生成式预训练通常忽略联合嵌入中几何增强带来的语义破坏,却无法避免负面现象“几何捷径”:暴露密集物体的空间与尺度先验会诱导模型通过插值物体位置简单重建场景,而非学习由边提供的底层拓扑约束。为此,本文提出拓扑布局学习(ToLL)框架用于3DSG生成预训练。具体设计了锚点条件下的拓扑几何推理模块,利用一个锚点和稀疏空间先验,通过递归图神经网络恢复零中心子图(不可见空间特征)的全局布局。由于物体内部缺乏空间布局信息,该设计形成信息瓶颈,迫使模型通过谓词表征学习来恢复完整场景布局。此外,构建结构多视角增强策略以避免语义破坏,通过自蒸馏增强3DSG表征。大量实验在特殊数据集上表明,ToLL能显著提升3DSG预训练质量,超越现有最先进基线。

原文摘要 · Abstract (English)

3D Scene Graph (3DSG) generation plays a pivotal role in spatial understanding and affordance perception. To mitigate generalization issues from data scarcity, joint-embedding and generative proxy tasks are proposed to pre-train 3DSG representations on predicate label-free datasets. Currently, generative pre-training usually bypasses the semantic corruption caused by the geometric augmentations in joint-embedding, but cannot avoid a negative problem ``Geometric Shortcut." In this problem, exposing dense object spatial and scale priors will induce models to trivially reconstruct scenes by interpolating object positions, rather than learning the underlying topological constraints provided by edges. To address this issue, we propose a Topological Layout Learning (ToLL) for 3DSG generation pretraining framework. In detail, we design an Anchor-Conditioned Topological Geometry Reasoning. It adopts a recurrent GNN to recover the global layout of zero-centered subgraphs (the non-visible spatial features) by one anchor with sparse spatial prior. Considering the absence of spatial layout information within the objects, it creates an information bottleneck, compelling our model to recover the full scene layout by leveraging predicate representation learning. Moreover, we construct a Structural Multi-view Augmentation to avoid semantic corruption, enhancing 3DSG representations via self-distillation. The extensive experiments on special dataset demonstrate that our ToLL could often improve 3DSG pertaining quality, outperforming state-of-the-art baselines.

3D场景图拓扑学习图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。