arXiv:2508.18268cs.ROcs.AI2025-08被引 9

给扩散模型生成的双臂操作加安全约束,提升成功率并减少危险动作。

SafeBimanual: Diffusion-based Trajectory Optimization for Safe Bimanual Manipulation

  • 通过设计多种安全代价函数,在扩散采样中动态优化双臂轨迹。
  • 在8个仿真任务中成功率达13.7%提升,不安全交互减少18.8%。
  • 使用视觉语言模型自动调度安全策略,适合真实场景部署。

双臂操作广泛应用于家庭服务与制造场景,能完成需协调配合的复杂任务。现有基于扩散模型的策略学习方法虽在建模动作分布方面表现良好,但忽略了双臂操作的物理安全约束,导致机器人或物体受损。为此,我们提出一种适用于任意预训练扩散模型的测试时轨迹优化框架 SafeBimanual,通过在双臂动作上施加安全约束,避免危险行为并提升成功率。具体地,针对不同双臂协作模式设计多样化的安全代价函数,涵盖物体撕裂避免与手臂-物体碰撞规避,并在扩散去噪采样过程中引导轨迹优化。同时,利用视觉语言模型(VLM)根据关键点及其成对关系动态调度代价函数,实现全过程的安全约束自适应生成。在 RoboTwin 模拟环境中,SafeBimanual 在8个任务上实现13.7%的成功率提升和18.8%的不安全交互下降;4个真实任务实验进一步验证其价值,成功率提升达32.5%。

原文摘要 · Abstract (English)

Bimanual manipulation has been widely applied in household services and manufacturing, which enables the complex task completion with coordination requirements. Recent diffusion-based policy learning approaches have achieved promising performance in modeling action distributions for bimanual manipulation. However, they ignored the physical safety constraints of bimanual manipulation, which leads to the dangerous behaviors with damage to robots and objects. To this end, we propose a test-time trajectory optimization framework named SafeBimanual for any pre-trained diffusion-based bimanual manipulation policies, which imposes the safety constraints on bimanual actions to avoid dangerous robot behaviors with improved success rate. Specifically, we design diverse cost functions for safety constraints in different dual-arm cooperation patterns including avoidance of tearing objects and collision between arms and objects, which optimizes the manipulator trajectories with guided sampling of diffusion denoising process. Moreover, we employ a vision-language model (VLM) to schedule the cost functions by specifying keypoints and corresponding pairwise relationship, so that the optimal safety constraint is dynamically generated in the entire bimanual manipulation process. SafeBimanual demonstrates superiority on 8 simulated tasks in RoboTwin with a 13.7% increase in success rate and a 18.8% reduction in unsafe interactions over state-of-the-art diffusion-based methods. Extensive experiments on 4 real-world tasks further verify its practical value by improving the success rate by 32.5%.

双臂操作扩散模型安全控制轨迹优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。