用思维链推理将少样本指令转为可执行的时序逻辑表达式
CoT-TL: Low-Resource Temporal Knowledge Representation of Planning Instructions Using Chain-of-Thought Reasoning
- 通过思维链和语义角色增强,实现低资源下的自然语言到时序逻辑转换
- 在三个数据集上零微调下达到当前最优准确率,最高提升12.3%
- 适用于无人机等自主系统,生成过程透明且可验证
自主代理常面临解析不确定自然语言规划指令的挑战。将这些指令表示为线性时序逻辑(LTL)可使规划器生成可执行计划。我们提出CoT-TL,一种数据高效的上下文学习框架,用于将自然语言规范转换为LTL表示。CoT-TL通过扩展思维链推理和语义角色,解决大语言模型依赖大量微调数据的局限性,使其更符合形式逻辑生成需求。该方法提升了LTL生成过程的透明度与可解释性,增强用户信任。CoT-TL在三个不同数据集的低数据场景下实现当前最优准确率,优于无需微调或中间翻译的现有方法。为提高可靠性并减少幻觉,我们引入模型检验验证生成LTL的语法正确性。通过消融实验及在新数据集上对未见LTL结构和公式的评估,进一步验证了其有效性。最后,我们将CoT-TL集成至四旋翼无人机中,基于自然语言指令完成多步飞行规划,证明了其实际可用性。
原文摘要 · Abstract (English)
Autonomous agents often face the challenge of interpreting uncertain natural language instructions for planning tasks. Representing these instructions as Linear Temporal Logic (LTL) enables planners to synthesize actionable plans. We introduce CoT-TL, a data-efficient in-context learning framework for translating natural language specifications into LTL representations. CoT-TL addresses the limitations of large language models, which typically rely on extensive fine-tuning data, by extending chain-of-thought reasoning and semantic roles to align with the requirements of formal logic creation. This approach enhances the transparency and rationale behind LTL generation, fostering user trust. CoT-TL achieves state-of-the-art accuracy across three diverse datasets in low-data scenarios, outperforming existing methods without fine-tuning or intermediate translations. To improve reliability and minimize hallucinations, we incorporate model checking to validate the syntax of the generated LTL output. We further demonstrate CoT-TL's effectiveness through ablation studies and evaluations on unseen LTL structures and formulas in a new dataset. Finally, we validate CoT-TL's practicality by integrating it into a QuadCopter for multi-step drone planning based on natural language instructions. Project details: \href{https://github.com/kumarmanas/TAMP\_COT\_TL}{https://github.com/kumarmanas/TAMP\_COT\_TL}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。