智能助手只在必要时介入,让人类掌控更自如。
Shared Autonomy with IDA: Interventional Diffusion Assistance
- 助手仅在它比人类决策更优时才干预,动态分配控制权。
- 在推杆和月球着陆任务中,性能优于纯人工或传统共控。
- 实测显示人类更认可这种设计,认为自己有更大自主权。
人工智能的快速发展揭示了辅助人类操控复杂技术的潜力。共享自主(SA)通过结合人类操作员与AI协作者的输入来实现控制。以往的SA研究中,协作者始终活跃,在每个时间步都决定动作,这限制了人类自主性,可能损害整体表现。我们假设:根据任务动态调整干预频率,可提升人类自主性和控制性能。为此,我们提出一种不依赖目标的干预协助(IA),其动态共享控制策略为:当协作者动作的预期价值超过人类动作时才介入。我们以目标掩码训练的扩散模型实现该策略(命名为IDA)。理论上证明了IA性能下界依赖于操作员与协作者的表现。模拟实验表明,IDA在多种推杆和月球着陆环境中的表现优于纯操作员与传统共控。真人参与的闭环实验进一步验证:在月球着陆任务中,IDA表现更优,参与者报告更高的自主感,并更偏好此方案。我们认为成功源于在保障人类主导权的同时,有效防止进入普遍差的状态。
原文摘要 · Abstract (English)
The rapid development of artificial intelligence (AI) has unearthed the potential to assist humans in controlling advanced technologies. Shared autonomy (SA) facilitates control by combining inputs from a human pilot and an AI copilot. In prior SA studies, the copilot is constantly active in determining the action played at each time step. This limits human autonomy and may have deleterious effects on performance. In general, the amount of helpful copilot assistance can vary greatly depending on the task dynamics. We therefore hypothesize that human autonomy and SA performance improve through dynamic and selective copilot intervention. To address this, we develop a goal-agnostic intervention assistance (IA) that dynamically shares control by having the copilot intervene only when the expected value of the copilot's action exceeds that of the human's action across all possible goals. We implement IA with a diffusion copilot (termed IDA) trained on expert demonstrations with goal masking. We prove a lower bound on the performance of IA that depends on pilot and copilot performance. Experiments with simulated human pilots show that IDA achieves higher performance than pilot-only and traditional SA control in variants of the Reacher environment and Lunar Lander. We then demonstrate that IDA achieves better control in Lunar Lander with human-in-the-loop experiments. Human participants report greater autonomy with IDA and prefer IDA over pilot-only and traditional SA control. We attribute the success of IDA to preserving human autonomy while simultaneously offering assistance to prevent the human pilot from entering universally bad states.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。