无需专家干预,自动解析自然语言规划任务
Planning in the Dark: LLM-Symbolic Planning Pipeline without Experts
- 构建动作模式库生成多种语义解释候选
- 自动验证与排序,保持规划性能优于直接使用LLM
- 适合无领域经验的用户使用,提升AI规划可及性
大型语言模型(LLMs)在解决自然语言描述的规划任务方面展现出潜力,但直接使用常导致推理不一致和幻觉。虽然混合式LLM-符号规划管道更稳健,但通常需要大量专家干预来修正和验证生成的动作模式。这不仅限制了可扩展性,还可能引入偏见,因为单个专家对模糊自然语言描述的理解未必符合用户真实意图。为此,我们提出一种新方法:构建动作模式库以生成多种候选方案,涵盖自然语言描述的多样解释;并引入语义验证与排序模块,实现无需人工介入的自动筛选与排序。实验表明,该管道在规划性能上优于直接使用LLM的方法。研究证明了完全自动化端到端的LLM-符号规划器的可行性,无需专家干预,为更广泛用户参与AI规划提供了可能。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have shown promise in solving natural language-described planning tasks, but their direct use often leads to inconsistent reasoning and hallucination. While hybrid LLM-symbolic planning pipelines have emerged as a more robust alternative, they typically require extensive expert intervention to refine and validate generated action schemas. It not only limits scalability but also introduces a potential for biased interpretation, as a single expert's interpretation of ambiguous natural language descriptions might not align with the user's actual intent. To address this, we propose a novel approach that constructs an action schema library to generate multiple candidates, accounting for the diverse possible interpretations of natural language descriptions. We further introduce a semantic validation and ranking module that automatically filter and rank the generated schemas and plans without expert-in-the-loop. The experiments showed our pipeline maintains superiority in planning over the direct LLM planning approach. These findings demonstrate the feasibility of a fully automated end-to-end LLM-symbolic planner that requires no expert intervention, opening up the possibility for a broader audience to engage with AI planning with less prerequisite of domain expertise.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。