用动作序列相似性优化大模型规划,显著提升准确率。
Improving Large Language Model Planning with Action Sequence Similarity
- 基于动作序列相似性筛选示例,避免误导性匹配
- 在多个任务上实现最高40点准确率提升,减少27.3%示例数量
- 适用于复杂规划问题,尤其适合小样本场景
规划是人工智能系统前瞻并主动确定行动路径以达成目标的关键能力。尽管大型语言模型(LLMs)在各类任务中展现出一定规划能力,但其性能受上下文信号影响尚不明确。本文研究如何通过上下文学习(ICL)提升模型规划能力,重点探讨哪些信号有助于选择有效示例。实验发现,传统问题相似性常导致看似相关实则计划迥异的错误匹配,会误导模型。为此,提出利用动作序列相似性(AS)进行示例采样与过滤。设计了两阶段流水线GRASE-DC:先重采样高AS示例,再基于动态聚类对选中示例进行精炼,兼顾相关性与多样性。实验表明,GRASE-DC在多个规划任务上取得显著性能提升(准确率最高提升~11-40点,平均仅需27.3%更少示例)。结合验证器的GRASE-DC* + VAL进一步提升18.9%性能。广泛分析证实该方法对多种骨干模型及经典与自然语言规划基准均具稳定增益,且在更难问题上,使用简单问题作示例可比随机基线提高约24个绝对点,展示其外分布泛化能力。
原文摘要 · Abstract (English)
Planning is essential for artificial intelligence systems to look ahead and proactively determine a course of actions to reach objectives in the virtual and real world. Recent work on large language models (LLMs) sheds light on their planning capability in various tasks. However, it remains unclear what signals in the context influence the model performance. In this work, we explore how to improve the model planning capability through in-context learning (ICL), specifically, what signals can help select the exemplars. Through extensive experiments, we observe that commonly used problem similarity may result in false positives with drastically different plans, which can mislead the model. In response, we propose to sample and filter exemplars leveraging plan side action sequence similarity (AS). We propose GRASE-DC: a two-stage pipeline that first re-samples high AS exemplars and then curates the selected exemplars with dynamic clustering on AS to achieve a balance of relevance and diversity. Our experimental result confirms that GRASE-DC achieves significant performance improvement on various planning tasks (up to ~11-40 point absolute accuracy improvement with 27.3% fewer exemplars needed on average). With GRASE-DC* + VAL, where we iteratively apply GRASE-DC with a validator, we are able to even boost the performance by 18.9% more. Extensive analysis validates the consistent performance improvement of GRASE-DC with various backbone LLMs and on both classical planning and natural language planning benchmarks. GRASE-DC can further boost the planning accuracy by ~24 absolute points on harder problems using simpler problems as exemplars over a random baseline. This demonstrates its ability to generalize to out-of-distribution problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。