arXiv:2508.03293cs.HCcs.RO2025-08

用置信度选择更高可信决策,提升人机协同效率

Enhancing Joint Human-AI Inference in Robot Missions: A Confidence-Based Approach

  • 基于置信度选择高可信判断,实现人机联合推理
  • 置信度校准良好的AI使准确率显著提升
  • 适合需人机协作的机器人任务场景

人机协同推理在人类监督的机器人任务中具有巨大潜力。当前多为人工智能辅助模式,由人工根据AI建议做出最终判断,但因人类在何时采纳或拒绝AI建议上判断失误,互补性难以实现。本文研究基于置信度选择更高可信判断的联合推理方法。通过在模拟机器人遥操作任务中对N=100名参与者进行用户研究,聚焦机器人控制延迟的推断,结果表明:a) 联合推理准确率更高,且其提升程度受AI置信度校准影响;b) 人类会依据AI建议调整自身判断,调整幅度与方向同样受AI置信度校准调节。有趣的是,表现不佳的置信度校准反而降低整体性能,凸显了具备元认知敏感性的AI决策支持系统的重要性。据我们所知,本研究首次将最大置信度启发式应用于模拟机器人遥操作任务中的联合人机推理。

原文摘要 · Abstract (English)

Joint human-AI inference holds immense potential to improve outcomes in human-supervised robot missions. Current day missions are generally in the AI-assisted setting, where the human operator makes the final inference based on the AI recommendation. However, due to failures in human judgement on when to accept or reject the AI recommendation, complementarity is rarely achieved. We investigate joint human-AI inference where the inference made with higher confidence is selected. Through a user study with N=100 participants on a representative simulated robot teleoperation task, specifically studying the inference of robots' control delays we show that: a) Joint inference accuracy is higher and its extent is regulated by the confidence calibration of the AI agent, and b) Humans change their inferences based on AI recommendations and the extent and direction of this change is also regulated by the confidence calibration of the AI agent. Interestingly, our results show that pairing poorly-calibrated AI-DSS with humans hurts performance instead of helping the team, reiterating the need for AI-based decision support systems with good metacognitive sensitivity. To the best of our knowledge, our study presents the first application of a maximum-confidence-based heuristic for joint human-AI inference within a simulated robot teleoperation task.

人机协同置信度机器人推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。