让机器人主动管理信任，提升人机协作成功率。
Active Trust Management for Successful Human-Robot Teaming: Moving from a Trust Repair to a Trust Satisficing Perspective
- 提出信任满足视角，动态调整机器人行为以维持合作基础。
- 通过代理指标在线测量信任，实现闭环适应与可变自主权。
- 适合高风险动态环境中需持续信任维护的人机团队研究者。
将移动机器人融入人类团队有望显著提升搜索危险环境等任务的效能。相较于现有遥控机器人，未来机器人系统将具备一定人工智能能力，拥有自主决策权以达成任务目标。这种自主性虽可增强团队效率，但若机器人出错或看似违背团队利益，可能损害人机互信。任务过程中，各成员（信任方）基于自身理解评估信任状态，当个体或系统级信任低于协作所需阈值时，可能严重影响任务成功。本文主张主动信任管理是人机团队（尤其是具身智能体）成功的关键前提，尤其在动态高风险环境中。提出信任满足视角，承认信任的多维、情境依赖和波动特性。构建的人机团队信任管理框架包含：在线测量信任代理指标、闭环调整机器人行为、可变自主权以保留人类在价值判断场景中的责任空间。参考近期关于‘快速信任’的实验及新型人机信任行为度量，指出有待深入探索的问题。
原文摘要 · Abstract (English)
Integrating mobile robots into human teams promises significant capability improvements for tasks such as searching hazardous environments. Unlike existing teleoperated robots, future robot systems will increasingly be endowed with some level of artificial intelligence (AI), giving them a degree of autonomy in how they pursue mission goals. This autonomy could make a human-agent (robot) team more effective but also put inter-agent trust under strain if robots make a mistake, or (appear to) pursue task priorities that conflict with the team's best interest. During a mission, agents' trust states are anticipated to vary according to the situation as understood by each teammate (trustor). If component-level (agent) or system-level trust falls below sufficient levels for cooperative tasks to be completed, it could critically affect mission success . We argue that active trust management will be an important precondition for the success of human-robot teams (HRTs, a subcategory of human-agent teams with embodied agents), especially in dynamic, high-risk environments. We present a trust satisficing perspective which acknowledges and attempts to account for the fluctuating, multi-faceted, and context-dependent nature of trust and trust requirements even under normal operating conditions. Our outline of a trust management framework for human-robot teaming includes online measurement of proxy metrics for trust, closed-loop adaptation of robot behavior, and variable autonomy to give space for human responsibility in situations requiring value judgements. We refer to a recent experimental exploration of 'swift trust' and a novel behavioral trust metric for HRT, and we highlight issues for further investigation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。