arXiv:2607.04234cs.ROcs.AI2026-07中稿 · ECCV被引 1

提出首个关注物理安全的可变形物体操作基准,评估抓取稳定性和形变控制。

SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects (Early Version)

论文配图:SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects (Early Version)
图 1 · 摘自论文原文
  • 基于有限元仿真构建多视角视觉与触觉数据,模拟真实物理交互
  • 首次分离评估任务成功率与安全成功率,发现90%以上成功任务仍不安全
  • 触觉反馈可提升安全成功率至35.6%,同时降低物体形变

可变形物体操作不仅需完成任务,还需保证物理交互安全:稳定抓持避免滑落或掉落,且形变不超过阈值。现有基准多聚焦任务完成度,极少评估执行过程中的安全性。我们提出SoftVTBench,一个面向物理约束下可变形物体操作的安全感知多模态基准。在Isaac Sim中构建,使用有限元法(FEM)模拟可变形物体,提供多视角RGB观测、带标记运动的触觉传感、本体感知及语言指令,并定义四组匹配任务,涵盖物体类型(可变形 vs. 刚性)和变化轴(物体自身 vs. 空间)。分别报告目标达成率(Goal Success)与安全达成率(Safety Success),后者要求无掉落且峰值形变低于校准的物体特定阈值,由策略不可见的特权FEM状态测量。我们基于pi0.5实现基线方法。实验表明,仅评估成功率会严重高估策略性能——大量成功轨迹仍违反物理安全。引入触觉感知后,安全成功率从21.4%提升至35.6%(物体中心任务),同时降低执行过程中的形变,而目标成功率保持相当。SoftVTBench为研究视觉-触觉协同的可变形操作提供了可复现的基准。

原文摘要 · Abstract (English)

Deformable object manipulation poses challenges beyond task completion: successful execution must also maintain safe physical interaction, holding the object stably without slip or drop while avoiding excessive deformation. However, existing manipulation benchmarks are predominantly success-oriented and rarely evaluate whether a policy remains physically safe throughout execution. We present SoftVTBench, a safety-aware visuo-tactile benchmark for physically constrained deformable object manipulation. Built in Isaac Sim with finite-element-simulated deformable objects, SoftVTBench provides multi-view RGB observations, RGB tactile sensing with marker motion, proprioception, and language instructions, and defines four matched task suites over object type (deformable vs. rigid) and variation axis (object vs. spatial). It separately reports Goal Success and Safety Success; the latter additionally requires no drop and peak deformation below a calibrated object-specific threshold, measured from policy-hidden privileged Finite Element Method (FEM) states. We implement pi0.5-based baselines under this protocol. Experiments show that success-only evaluation substantially overstates policy performance, as a large fraction of goal-completing rollouts still violate physical safety. Furthermore, incorporating tactile sensing improves Safety Success (e.g., from 21.4% to 35.6% on object-centric deformable tasks) and reduces object deformation during execution, while maintaining comparable Goal Success. SoftVTBench provides a reproducible benchmark for studying visuo-tactile deformable manipulation under physical interaction constraints.

机器人操作触觉感知物理安全可变形物体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。