让AI主动问对问题,用最少提问补全未知信息完成高效规划。
MINT: Minimal Information Neuro-Symbolic Tree for Objective-Driven Knowledge-Gap Reasoning and Active Elicitation
- 构建符号树分析知识缺口,结合神经策略估算规划不确定性。
- 在三个真实场景中仅用少量提问就接近专家水平的规划表现。
- 适合需要人机协作规划、追求低交互成本的智能系统研发者。
基于语言的人机协同规划是人机协作的关键领域。开放世界中的规划常面临信息不全和未知因素,如涉及的物体、人类目标或意图,从而导致知识缺口。本文研究如何让AI代理在以物体驱动的规划中,主动设计最优的交互策略来获取人类输入。为此,提出最小信息神经符号树(MINT),通过构建可能的人机交互命题,并结合神经规划策略评估因知识缺口带来的规划结果不确定性。最终利用大模型搜索并总结MINT的推理过程,生成一组能最优获取人类输入的查询。通过扩展马尔可夫决策过程建模知识缺口,我们分析了含主动人机交互的MINT的回报保证性。在三个包含日益真实的未见/未知物体的基准测试中,基于MINT的规划在每任务仅发出有限问题的情况下,实现了接近专家水平的回报,显著提升了奖励与成功率。
原文摘要 · Abstract (English)
Joint planning through language-based interactions is a key area of human-AI teaming. Planning problems in the open world often involve various aspects of incomplete information and unknowns, e.g., objects involved, human goals/intents -- thus leading to knowledge gaps in joint planning. We consider the problem of discovering optimal interaction strategies for AI agents to actively elicit human inputs in object-driven planning. To this end, we propose Minimal Information Neuro-Symbolic Tree (MINT) to reason about the impact of knowledge gaps and leverage self-play with MINT to optimize the AI agent's elicitation strategies and queries. More precisely, MINT builds a symbolic tree by making propositions of possible human-AI interactions and by consulting a neural planning policy to estimate the uncertainty in planning outcomes caused by remaining knowledge gaps. Finally, we leverage LLM to search and summarize MINT's reasoning process and curate a set of queries to optimally elicit human inputs for best planning performance. By considering a family of extended Markov decision processes with knowledge gaps, we analyze the return guarantee for a given MINT with active human elicitation. Our evaluation on three benchmarks involving unseen/unknown objects of increasing realism shows that MINT-based planning attains near-expert returns by issuing a limited number of questions per task while achieving significantly improved rewards and success rates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。