arXiv:2604.04050cs.CVcs.LG2026-04中稿 · ECCV被引 4

通过拓扑对齐提升3D拼装的生成效率与泛化能力

TORA: Topological Representation Alignment for 3D Shape Assembly

论文配图:TORA: Topological Representation Alignment for 3D Shape Assembly
图 1 · 摘自论文原文
  • 用预训练模型的几何关系指导拼装过程的运动方向
  • 使收敛速度提升最多6.9倍,且在跨域场景下更鲁棒
  • 无需额外计算开销,适合需要高效生成的工业应用

3D形状拼装的流匹配方法通过点级速度场将部件运送到组装构型,但缺乏对跨部件相互作用如何驱动运动的明确指导。本文提出TORA,一种以拓扑结构为核心的表示对齐框架,在训练中将冻结的预训练3D编码器所提取的关系结构注入流匹配主干网络。首先采用简单的逐标记余弦匹配,引入教师模型的几何描述符;进一步使用中心核对齐(CKA)损失,匹配学生与教师表示间的相似性结构,增强拓扑对齐。系统性测试多种3D编码器表明,几何与接触特性决定对齐效果,而非语义分类能力,且对齐在变压器后层效果最佳,此时空间结构自然显现。TORA在推理时零开销,带来一致优势:收敛速度最高提升6.9倍,分布内精度更高,并在域偏移下表现更强鲁棒性。五个基准测试涵盖几何、语义及物间拼装任务,均达当前最优,尤其在未见的真实与合成数据集上展现显著零样本迁移性能。

原文摘要 · Abstract (English)

Flow-matching methods for 3D shape assembly learn point-wise velocity fields that transport parts toward assembled configurations, yet they receive no explicit guidance about which cross-part interactions should drive the motion. We introduce TORA, a topology-first representation alignment framework that distills relational structure from a frozen pretrained 3D encoder into the flow-matching backbone during training. We first realize this via simple instantiation, token-wise cosine matching, which injects the learned geometric descriptors from the teacher representation. We then extend to employ a Centered Kernel Alignment (CKA) loss to match the similarity structure between student and teacher representations for enhanced topological alignment. Through systematic probing of diverse 3D encoders, we show that geometry- and contact-centric teacher properties, not semantic classification ability, govern alignment effectiveness, and that alignment is most beneficial at later transformer layers where spatial structure naturally emerges. TORA introduces zero inference overhead while yielding two consistent benefits: faster convergence (up to 6.9$\times$) and improved accuracy in-distribution, along with greater robustness under domain shift. Experiments on five benchmarks spanning geometric, semantic, and inter-object assembly demonstrate state-of-the-art performance, with particularly pronounced gains in zero-shot transfer to unseen real-world and synthetic datasets. Project page: https://nahyuklee.github.io/tora.

3D生成拓扑对齐流匹配零样本迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。