arXiv:2503.19317cs.RO2025-03被引 6

统一人与机器人不确定性,提升偏好学习准确性和可靠性。

Towards Uncertainty Unification: A Case Study for Preference Learning

  • 提出不确定性统一框架,融合人类偏好与机器人系统的不确定性。
  • 在预测准确性和用户评分上达到当前最优表现。
  • 适合关注人机交互中不确定性建模的研究者和工程师。

学习人类偏好对人机交互至关重要,能使机器人行为适应人类期望与目标。然而,人类行为和机器人系统中的固有不确定性使偏好学习极具挑战。尽管概率机器人算法能提供不确定性量化,但人类偏好不确定性的整合仍待深入探索。为此,本文提出不确定性统一框架,构建了不确定性统一的偏好学习(UUPL)方法,通过统一人类与机器人不确定性,增强基于高斯过程(GP)的偏好学习性能。具体而言,UUPL包含一个改进高斯过程后验均值估计的人类偏好不确定性模型,以及一个提升预测方差准确性的不确定性加权高斯混合模型(GMM)。此外,设计了用户特定校准流程,以对齐不同用户的不确定性表示,确保模型性能的一致性与可靠性。全面实验与用户研究显示,UUPL在预测精度与用户评分上均达到当前最优水平。消融实验证明了人类不确定性模型和不确定性加权GMM的有效性。

原文摘要 · Abstract (English)

Learning human preferences is essential for human-robot interaction, as it enables robots to adapt their behaviors to align with human expectations and goals. However, the inherent uncertainties in both human behavior and robotic systems make preference learning a challenging task. While probabilistic robotics algorithms offer uncertainty quantification, the integration of human preference uncertainty remains underexplored. To bridge this gap, we introduce uncertainty unification and propose a novel framework, uncertainty-unified preference learning (UUPL), which enhances Gaussian Process (GP)-based preference learning by unifying human and robot uncertainties. Specifically, UUPL includes a human preference uncertainty model that improves GP posterior mean estimation, and an uncertainty-weighted Gaussian Mixture Model (GMM) that enhances GP predictive variance accuracy. Additionally, we design a user-specific calibration process to align uncertainty representations across users, ensuring consistency and reliability in the model performance. Comprehensive experiments and user studies demonstrate that UUPL achieves state-of-the-art performance in both prediction accuracy and user rating. An ablation study further validates the effectiveness of human uncertainty model and uncertainty-weighted GMM of UUPL.

偏好学习不确定性建模人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。