提升机器人操作安全性,让智能体更抗干扰
ACORN: Adaptive Contrastive Optimization for Safe and Robust Fine-Grained Robotic Manipulation
- 用对比学习让智能体模仿专家动作,避开危险行为
- 在扰动下安全指标最高提升23%,且不降低任务成功率
- 适合需要高可靠性的真实场景机器人应用
具身AI研究长期关注成功率和累积奖励等性能指标,忽视了实际部署中出现的鲁棒性和安全性问题。在真实环境中,智能体持续面临未预期情境与分布偏移,导致看似可靠的策略出现灾难性失败,尤其在操作任务中更为突出。为此,我们提出四种以安全为中心的新指标,量化智能体对环境扰动的韧性。基于这些指标,我们提出自适应对比优化方法ACORN,一种即插即用的算法,可在不牺牲性能的前提下增强策略鲁棒性。ACORN利用对比学习同时对齐专家示范轨迹并分离潜在危险行为。通过结构化高斯噪声注入高效生成有信息量的负样本,采用双重扰动技术在保持样本多样性的同时最小化计算开销。在多种操作环境中全面实验表明,相较于基线方法,ACORN在扰动下安全指标最高提升23%。这些结果凸显其在安全关键的真实世界应用中实现可靠部署的巨大潜力。
原文摘要 · Abstract (English)
Embodied AI research has traditionally emphasized performance metrics such as success rate and cumulative reward, overlooking critical robustness and safety considerations that emerge during real-world deployment. In actual environments, agents continuously encounter unpredicted situations and distribution shifts, causing seemingly reliable policies to experience catastrophic failures, particularly in manipulation tasks. To address this gap, we introduce four novel safety-centric metrics that quantify an agent's resilience to environmental perturbations. Building on these metrics, we present Adaptive Contrastive Optimization for Robust Manipulation (ACORN), a plug-and-play algorithm that enhances policy robustness without sacrificing performance. ACORN leverages contrastive learning to simultaneously align trajectories with expert demonstrations while diverging from potentially unsafe behaviors. Our approach efficiently generates informative negative samples through structured Gaussian noise injection, employing a double perturbation technique that maintains sample diversity while minimizing computational overhead. Comprehensive experiments across diverse manipulation environments validate ACORN's effectiveness, yielding improvements of up to 23% in safety metrics under disturbance compared to baseline methods. These findings underscore ACORN's significant potential for enabling reliable deployment of embodied agents in safety-critical real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。