arXiv:2603.19543cs.RO2026-03

无需视觉监督,用触觉传感器实现软体机器人零样本形变重建

Zero Shot Deformation Reconstruction for Soft Robots Using a Flexible Sensor Array and Cage Based 3D Gaussian Modeling

  • 结合柔性触觉阵列与笼结构3D高斯模型,通过触觉信号推断全局形变
  • 在未见过的软体机器人上实现0.67 IoU、3.48 mm Chamfer距离的重建精度
  • 适合无相机环境下的实时形变感知,尤其适用于柔性机器人控制

我们提出一种无需视觉监督的软体机器人零样本形变重建框架。该方法在部署时无需收集特定对象的形变数据或重新训练,仅依赖触觉传感实现无相机形变推断。系统基于物体的静态几何原型(如STL模型),利用柔性压阻式传感器阵列获取局部触觉信号,映射为低维笼控信号,并通过图注意力网络回归笼位移,实现空间平滑与结构连续性约束。这些信号被传播至密集高斯原语以生成全局一致的形变结果。在弯曲和扭转运动中,系统仅凭名义几何模型与实时触觉输入,即可完成未见过软体机器人的形变重建,并实时渲染逼真RGB图像。实验表明,其在未见物体上达到0.67 IoU、0.65 SSIM与3.48 mm Chamfer距离,验证了触觉与结构化几何形变显式耦合带来的强零样本泛化能力。

原文摘要 · Abstract (English)

We present a zero-shot deformation reconstruction framework for soft robots that operates without any visual supervision at inference time. In this work, zero-shot deformation reconstruction is defined as the ability to infer object-wide deformations on previously unseen soft robots without collecting object-specific deformation data or performing any retraining during deployment. Our method assumes access to a static geometric proxy of the undeformed object, which can be obtained from a STL model. During operation, the system relies exclusively on tactile sensing, enabling camera-free deformation inference. The proposed framework integrates a flexible piezoresistive sensor array with a geometry-aware, cage-based 3D Gaussian deformation model. Local tactile measurements are mapped to low-dimensional cage control signals and propagated to dense Gaussian primitives to generate globally consistent shape deformations. A graph attention network regresses cage displacements from tactile input, enforcing spatial smoothness and structural continuity via boundary-aware propagation. Given only a nominal geometric proxy and real-time tactile signals, the system performs zero-shot deformation reconstruction of unseen soft robots in bending and twisting motions, while rendering photorealistic RGB in real time. It achieves 0.67 IoU, 0.65 SSIM, and 3.48 mm Chamfer distance, demonstrating strong zero-shot generalization through explicit coupling of tactile sensing and structured geometric deformation.

软体机器人触觉感知零样本重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。