arXiv:2608.28570cs.RO2026-08

从多视角视频中联合学习柔性线状物体的几何、运动与动力学,实现高精度重建与实时控制。

ChainSplat: A Physics-Inspired Screw-Theoretic Model for Learning Deformable Linear Object Dynamics from Multi-View RGB Videos

论文配图:ChainSplat: A Physics-Inspired Screw-Theoretic Model for Learning Deformable Linear Object Dynamics from Multi-View RGB Videos
图 1 · 摘自论文原文
  • 将柔性线状物建模为由旋转关节连接的刚体链,用螺旋理论实现紧凑状态表示
  • 仅凭多视角RGB视频即可完成3D几何、外观与动力学的联合重建,真实场景下表现领先
  • 支持实时状态与受力估计,适用于机器人抓取等实际操控任务

识别柔性线状物体(如电缆、绳索、软管)的内在动力学与三维几何对精准机器人操作至关重要,但因其高维配置空间和材料属性差异导致的行为多样性而极具挑战。现有方法常依赖多阶段流程与辅助深度输入,在动态交互下易出错,且高维状态表示使模型控制计算开销大。本文提出ChainSplat,一种物理启发的框架,仅通过多视角RGB视频联合学习柔性线状物体的3D几何、外观、运动学与动力学。ChainSplat将物体建模为由旋转关节连接的开链结构,采用解析的螺旋理论模型,以关节配置参数化紧凑状态空间。结合高斯点阵,该方法联合恢复物体动力学、运动学感知的3D几何与外观,并支持任意状态下的高保真RGB渲染。在真实实验中,ChainSplat在动态交互下实现了动力学预测、3D几何重建与图像渲染的当前最优性能。其进一步支持实时状态与力估计,以及精确的基于模型的轨迹优化,凸显其在真实机器人操控中的实用价值。代码与视频见:https://chainsplat.github.io。

原文摘要 · Abstract (English)

Identifying the underlying dynamics and 3D geometry of deformable linear objects (DLOs), such as cables, ropes, and hoses, is essential for accurate robotic manipulation, but remains challenging due to their high-dimensional configuration spaces and diverse behaviors arising from varying material properties. Existing methods often rely on multi-stage pipelines and auxiliary depth inputs, which are prone to errors under dynamic interactions, while their high-dimensional state representations make model-based control computationally expensive. In this paper, we introduce ChainSplat, a physics-inspired framework that jointly learns the 3D geometry, appearance, kinematics, and dynamics of DLOs solely from multi-view RGB videos. ChainSplat represents a DLO as an open-chain structure of rigid links connected by revolute joints, yielding an analytic, screw-theoretic model with a compact state representation parameterized by joint configurations. By integrating this formulation with Gaussian splatting, ChainSplat jointly recovers DLO dynamics, kinematics-aware 3D geometry, and appearance, while enabling high-fidelity RGB rendering from arbitrary states. Through real-world experiments, we demonstrate that ChainSplat achieves state-of-the-art performance in dynamics predictions, 3D geometry reconstruction, and RGB rendering across dynamic interactions. ChainSplat further enables real-time state and force estimation, as well as accurate model-based trajectory optimization, highlighting its practical utility for real-world robotic manipulation of DLOs. Accompanying source code and video are available at: https://chainsplat.github.io.

柔性物体3D重建机器人操控神经渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。