用几何引导变形模板,实现跨视角、跨类别的3D形状重建。
Geometry-Guided Modeling of Foundation Features Enables Generalizable Object Shape Deformation Learning

- 以类别级模板为基础,通过几何引导增强特征来精准变形匹配目标。
- 在多种视角和新类别上表现优越,显著提升3D形状重建泛化能力。
- 适合需要高精度3D形状理解的机器人操作等实际应用。
单目3D形状恢复是几何理解的基础,但要在任意视角和未见物体类别间实现鲁棒泛化仍具挑战。本文提出一种可泛化的变形学习框架,通过显式变形类别级形状模板以匹配目标观测。为应对模板与目标间的复杂形变差异,引入几何引导特征建模机制:先将模板拓扑信息融入基础特征,生成几何感知表示,再与目标观测显式关联以指导精确变形。此外,为弥合固定模板与任意目标视角间的差距,提出视图自适应特征聚合模块,利用多视角模板特征及其对应相机位姿,丰富标准模板表示,确保不同视角下特征对齐的鲁棒性。大量实验表明,该方法在处理大形变和多样视角方面显著优于现有最优方法,在新类别上展现强泛化能力,并有效支持下游真实世界的灵巧机器人操作任务。
原文摘要 · Abstract (English)
Monocular 3D shape recovery is fundamental to geometric understanding, yet achieving robust generalization across arbitrary viewpoints and unseen object categories remains a significant challenge. In this paper, we present a generalizable deformation learning framework that reconstructs 3D objects by explicitly deforming a category-level shape template to match the target observation. To address complex shape variations between the template and the target, we introduce a geometry-guided feature modeling mechanism. This process first enriches foundation features with template topology to yield a geometry-aware representation, which is then explicitly correlated with the target observation to guide precise deformation. Furthermore, to bridge the disparity between the fixed template and arbitrary target views, we propose a view-adaptive feature aggregation module. This module leverages multi-view template features and their corresponding camera poses to enrich the canonical template representation, ensuring robust feature alignment regardless of the target's perspective. Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art methods in handling large shape variations and diverse viewpoints, exhibiting strong generalization to novel categories and effectively supporting downstream real-world dexterous robotic manipulation tasks. Project homepage: https://GODeform.github.io/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。