用动态3D高斯建模可动物体,实现无对应点的分割与运动估计
Part Segmentation and Motion Estimation for Articulated Objects with Dynamic 3D Gaussians
- 将物体拆解为随时间变化的3D高斯块,统一建模部件与运动
- 在遮挡情况下仍能准确分割部件,比现有方法高13%性能
- 适合传感器异步采集或严重遮挡场景,对缺失点更鲁棒
部件分割与运动估计是分析可动物体运动的基础问题。本文提出一种联合求解方法,从单个可动物体的点云序列中进行分析。难点在于点云并非由固定移动点生成,而是每个时间步可能为物体表面任意采样,常见于大范围遮挡或多传感器异步采集场景。此类情况下依赖点对应关系的方法不适用。本文采用紧凑有效的表示:将物体视为一组随时间变化的3D高斯基元,其旋转、平移、缩放参数跨时间共享。通过将观测点与高斯块建立对应,实现部件分割;同时可通过分配高斯的位姿推算任意点的时序运动(即使该点未被观测)。实验表明,本方法优于仅依赖点对应的方法。我们扩展了现有数据集以模拟真实遮挡场景,并证明本方法在缺失点情况下更具鲁棒性,即便某些部件在部分时间步完全被遮挡。尤其在带遮挡的点云上,部件分割性能较当前最优方法提升13%。
原文摘要 · Abstract (English)
Part segmentation and motion estimation are two fundamental problems for articulated object motion analysis. In this paper, we present a method to solve these two problems jointly from a sequence of observed point clouds of a single articulated object. The main challenge in our problem setting is that the point clouds are not assumed to be generated by a fixed set of moving points. Instead, each point cloud in the sequence could be an arbitrary sampling of the object surface at that particular time step. Such scenarios occur when the object undergoes major occlusions, or if the dataset is collected using measurements from multiple sensors asynchronously. In these scenarios, methods that rely on tracking point correspondences are not appropriate. We present an alternative approach based on a compact but effective representation where we represent the object as a collection of simple building blocks modeled as 3D Gaussians. We parameterize the Gaussians with time-dependent rotations, translations, and scales that are shared across all time steps. With our representation, part segmentation can be achieved by building correspondences between the observed points and the Gaussians. Moreover, the transformation of each point across time can be obtained by following the poses of the assigned Gaussian (even when the point is not observed). Experiments show that our method outperforms existing methods that solely rely on finding point correspondences. Additionally, we extend existing datasets to emulate real-world scenarios by considering viewpoint occlusions. We further demonstrate that our method is more robust to missing points as compared to existing approaches on these challenging datasets, even when some parts are completely occluded in some time-steps. Notably, our part segmentation performance outperforms the state-of-the-art method by 13% on point clouds with occlusions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。