让3D模型能用:自动补全结构并修正错误动作。
Functionalization via Structure Completion and Motion Rectification

- 用图结构表示物体功能关系,缺失部分变作图补全任务。
- 在233个家具数据上,动作更合理且连接更牢固。
- 适合做3D建模、动画生成的开发者或研究者参考。
3D资产的获取与创建长期依赖视觉或外观表现,导致现有数字模型常缺少实现功能所需的结构部件,如关节、支撑、内部结构或交互元素。同时,人工标注的动作也常含物理不合理的错误。本文提出物体功能化任务,旨在将视觉合理但无法使用的3D模型转化为可操作且物理合理的功能性模型。方法将功能化建模为新的功能图结构补全问题:节点代表物体部件,边表示功能和接触关系,可动节点携带运动属性,结构缺陷表现为缺失节点或错误边。提出神经图功能化器(GraFu)完成不完整图结构,进而驱动几何实现阶段生成预测的连接件与结构元素,同时修正错误的人工标注与预测动作。为支持训练与评估,聚焦家具这一复杂类别,构建了包含233对非功能性与功能化家具模型的FurFun-233数据集。在PartNet-Mobility(零样本)与HSSD测试集上,本方法在动作预测精度上达到当前最优,同时显著提升碰撞规避与连接完整性。
原文摘要 · Abstract (English)
Acquisition and creation of 3D assets have been largely view- or appearance-driven. As a result, existing digital 3D models often lack the requisite structural components to function as intended, such as joints, supports, interiors, or interaction elements. At the same time, even human-annotated motions are frequently error-prone, leading to physically implausible behavior. We introduce object functionalization, a novel task aimed at transforming visually plausible but non-functional 3D models into functional and physically operable ones. We formulate functionalization as a graph completion problem over a new functional graph representation, where labeled nodes represent object parts, labeled edges encode functional and contact relations, and movable nodes carry motion attributes, so that structural functional deficiencies manifest as missing nodes or incorrect edges. We develop a neural Graph Functionalizer (GraFu) to complete an incomplete graph representing a non-functional 3D object. The completed graph then drives a geometry realization stage that instantiates predicted connectors and structural elements in 3D, with the compelling side effect of rectifying erroneous human-annotated and predicted motions. To support training and evaluation, focusing on furniture as a rich and challenging target category, we introduce FurFun-233, a dataset of 233 paired non-functional and functionalized furniture models. On PartNet-Mobility ("zero-shot") and HSSD test sets, our method matches state-of-the-art methods in motion prediction accuracy while substantially improving functionality in terms of collision and connectivity. Project page: https://mingrui-zhao.github.io/Functionalization/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。