arXiv:2412.02818cs.ROcs.LG2024-12被引 8

用虚拟环境生成漏洞地图,高效发现机器人操作的隐藏缺陷。

RoboMD: Uncovering Robot Vulnerabilities through Semantic Potential Fields

  • 构建视觉语言嵌入空间作为势场,学习预测漏洞区域
  • 在仿真和真实机械臂上比现有方法多发现23%漏洞
  • 适合研究机器人安全与鲁棒性提升的开发者

机器人操作策略虽是物理AI的核心,却易受现实世界外部变化影响而失效。诊断此类漏洞面临两大挑战:一是潜在干扰因素未知,二是真实测试成本高且危险。本文提出框架,通过在有限成功/失败数据训练的连续视觉语言嵌入空间中进行虚拟滚动,学习独立的深度强化学习(deep RL)漏洞预测策略。将该嵌入空间视为包含语义与视觉变化的势场,策略学会向脆弱区域移动,同时被成功区域排斥。该策略在虚拟环境中训练,实现可扩展、安全的漏洞分析,无需昂贵物理实验。通过查询该策略,框架生成概率漏洞分布图。在仿真基准和真实机械臂上的实验表明,本框架比先进视觉语言基线多发现23%的唯一漏洞,揭示了启发式测试忽略的细微缺陷。此外,利用本框架发现的漏洞对操作策略进行微调,仅需少量数据即可显著提升性能。

原文摘要 · Abstract (English)

Robot manipulation policies, while central to the promise of physical AI, are highly vulnerable in the presence of external variations in the real world. Diagnosing these vulnerabilities is hindered by two key challenges: (i) the relevant variations to test against are often unknown, and (ii) direct testing in the real world is costly and unsafe. We introduce a framework that tackles both issues by learning a separate deep reinforcement learning (deep RL) policy for vulnerability prediction through virtual runs on a continuous vision-language embedding trained with limited success-failure data. By treating this embedding space, which is rich in semantic and visual variations, as a potential field, the policy learns to move toward vulnerable regions while being repelled from success regions. This vulnerability prediction policy, trained on virtual rollouts, enables scalable and safe vulnerability analysis without expensive physical trials. By querying this policy, our framework builds a probabilistic vulnerability-likelihood map. Experiments across simulation benchmarks and a physical robot arm show that our framework uncovers up to 23% more unique vulnerabilities than state-of-the-art vision-language baselines, revealing subtle vulnerabilities overlooked by heuristic testing. Additionally, we show that fine-tuning the manipulation policy with the vulnerabilities discovered by our framework improves manipulation performance with much less fine-tuning data.

机器人安全漏洞检测强化学习视觉语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。