让机器人通过对话推断物品归属,更准更可靠。
Whose Is This?: Context-Aware Object Ownership Inference with Uncertainty-Guided Questioning

- 用大模型融合用户背景和使用历史估算归属分。
- 不确定时主动提问,准确率高达98.8%。
- 适合共享物品或临时借用场景,实用性强。
服务机器人需推断物品归属以正确理解指令,如“把我的杯子拿来”。但归属是不可直接观测的隐变量,现有方法多依赖近期使用等有限线索,在临时共享等场景下可靠性差。本文提出上下文感知的归属推断框架COIN,利用大语言模型整合用户背景与物品使用历史,计算归属得分。为应对不确定性,采用合规预测构建可能拥有者集合,并在预测置信度低时选择性生成用户问题。模拟家庭环境中实验表明,该方法持续优于基线,达到0.988的子集准确率和0.991的平均交并比,且在临时使用与共享所有权场景中表现稳健。结果表明,结合上下文推理与不确定性驱动交互可显著提升推断准确性与鲁棒性。
原文摘要 · Abstract (English)
Service robots must infer object ownership to correctly interpret instructions such as "bring me my cup." However, ownership is a latent attribute that cannot be directly observed, and existing methods often rely on limited cues such as recent usage, making them unreliable in scenarios such as temporary sharing. We propose a framework for context-aware ownership inference with uncertainty-guided interaction (COIN). The method integrates user background information and object usage history using a large language model (LLM) to estimate ownership scores. To handle uncertainty, we apply conformal prediction to construct a set of plausible owners and selectively generate user queries when the prediction is uncertain. Experiments in a simulated home environment show that the proposed method consistently outperforms baseline approaches, achieving a Subset Accuracy of 0.988 and a Mean Jaccard index of 0.991. The method also maintains high performance in scenarios involving temporary use and shared ownership. The results demonstrate that combining contextual reasoning with uncertainty-aware interaction improves both estimation accuracy and robustness. The project page is available at https://emergentsystemlabstudent.github.io/COIN/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。