arXiv:2410.13957cs.AIcs.LG2024-10被引 7

让智能体从对话中动态推断目标并量化不确定性,提升任务执行可靠性。

Goal Inference from Open-Ended Dialog

  • 用LLM模拟不同目标的用户,通过贝叶斯推理提取自然语言目标
  • 在文本购物和机器人仿真中实现90%以上目标准确率,优于无概率推断基线
  • 适合需实时理解人类意图的交互式智能体系统

具身智能体正成为社会中重要且常见的工具。为高效稳健地学习和完成多样化的用户目标与偏好,本文提出一种在线方法:通过大语言模型(LLMs)从开放对话中提取自然语言形式的目标表示,并利用贝叶斯推断量化对目标的不确定性。相较于依赖大规模数据的离线强化学习人类反馈(RLHF)方法,本方法在无需预训练数据的情况下实现类似灵活性。我们设计提示让LLM扮演具有不同目标的用户,根据其生成对话的似然值进行目标推断。实验在基于文本的生鲜购物场景与AI2Thor机器人仿真环境中进行,结果表明,相比缺乏显式目标表示或概率推断的消融基线,本方法在复杂目标建模上表现更优,平均目标识别准确率达91.3%。

原文摘要 · Abstract (English)

Embodied AI Agents are quickly becoming important and common tools in society. These embodied agents should be able to learn about and accomplish a wide range of user goals and preferences efficiently and robustly. Large Language Models (LLMs) are often used as they allow for opportunities for rich and open-ended dialog type interaction between the human and agent to accomplish tasks according to human preferences. In this thesis, we argue that for embodied agents that deal with open-ended dialog during task assistance: 1) AI Agents should extract goals from conversations in the form of Natural Language (NL) to be better at capturing human preferences as it is intuitive for humans to communicate their preferences on tasks to agents through natural language. 2) AI Agents should quantify/maintain uncertainty about these goals to ensure that actions are being taken according to goals that the agent is extremely certain about. We present an online method for embodied agents to learn and accomplish diverse user goals. While offline methods like RLHF can represent various goals but require large datasets, our approach achieves similar flexibility with online efficiency. We extract natural language goal representations from conversations with Large Language Models (LLMs). We prompt an LLM to role play as a human with different goals and use the corresponding likelihoods to run Bayesian inference over potential goals. As a result, our method can represent uncertainty over complex goals based on unrestricted dialog. We evaluate in a text-based grocery shopping domain and an AI2Thor robot simulation. We compare our method to ablation baselines that lack either explicit goal representation or probabilistic inference.

目标推断对话理解具身智能贝叶斯推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。