arXiv:2510.26786cs.CVcs.GR2025-10NeurIPS

从数据中自动学习运动层级结构,让复杂动作更可解释。

HEIR: Learning Graph-Based Motion Hierarchies

  • 用图神经网络建模运动元素间的父子依赖关系
  • 在1D/2D运动中恢复出真实层级结构,3D场景更逼真
  • 适合需要可解释运动建模的视觉与机器人任务

运动的层次结构广泛存在于计算机视觉、图形学和机器人学中,复杂动态通常由简单运动组件的协同作用产生。现有方法依赖人工定义或启发式层级结构,且使用固定运动基元,泛化能力受限。本文提出一种通用的层次化运动建模方法,直接从数据中学习结构化、可解释的运动关系。方法采用基于图的层次结构表示观测运动,显式将全局绝对运动分解为父级继承模式和局部残差。将层级推断建模为可微分图学习问题,节点代表基本运动,有向边通过图神经网络捕捉学习到的父子依赖关系。在三个实例上评估:1维平移运动、2维旋转运动,以及基于高斯点阵的动态3维场景变形。实验结果表明,该方法在1维和2维情况下重建了内在运动层级,在动态3维高斯点阵场景中生成了更真实、更可解释的变形效果。所提出的自适应、数据驱动的层次建模范式适用于广泛的以运动为中心的任务。

原文摘要 · Abstract (English)

Hierarchical structures of motion exist across research fields, including computer vision, graphics, and robotics, where complex dynamics typically arise from coordinated interactions among simpler motion components. Existing methods to model such dynamics typically rely on manually-defined or heuristic hierarchies with fixed motion primitives, limiting their generalizability across different tasks. In this work, we propose a general hierarchical motion modeling method that learns structured, interpretable motion relationships directly from data. Our method represents observed motions using graph-based hierarchies, explicitly decomposing global absolute motions into parent-inherited patterns and local motion residuals. We formulate hierarchy inference as a differentiable graph learning problem, where vertices represent elemental motions and directed edges capture learned parent-child dependencies through graph neural networks. We evaluate our hierarchical reconstruction approach on three examples: 1D translational motion, 2D rotational motion, and dynamic 3D scene deformation via Gaussian splatting. Experimental results show that our method reconstructs the intrinsic motion hierarchy in 1D and 2D cases, and produces more realistic and interpretable deformations compared to the baseline on dynamic 3D Gaussian splatting scenes. By providing an adaptable, data-driven hierarchical modeling paradigm, our method offers a formulation applicable to a broad range of motion-centric tasks. Project Page: https://light.princeton.edu/HEIR/

运动建模图神经网络可解释性3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。