首个面向时空感知旅行规划的检索增强基准,提升路线效率与景点合理性。
TP-RAG: Benchmarking Retrieval-Augmented Large Language Model Agents for Spatiotemporal-Aware Travel Planning
- 构建包含2348个真实旅行查询的基准,融合轨迹与地点细粒度标注。
- 引入参考轨迹使路线空间效率提升,景点合理性显著改善。
- 提出EvoRAG框架,适合开发智能旅行助手或研究多源信息融合。
大型语言模型在自动化旅行规划方面展现出潜力,但常缺乏对复杂时空合理性的把握。现有基准多关注基础计划有效性,忽视路线效率、景点吸引力及实时适应性等关键维度。本文提出首个面向检索增强型时空感知旅行规划的基准TP-RAG,数据集包含2,348个真实旅行查询、85,575个细粒度标注的兴趣点(POI)以及18,784条高质量旅行轨迹参考,均来自在线旅游文档,支持动态上下文感知规划。大量实验表明,引入参考轨迹可显著提升规划的空间效率与景点合理性,但因参考信息冲突和噪声数据,通用性与鲁棒性仍存挑战。为此,我们提出EvoRAG——一种进化式框架,能有效融合多样检索轨迹与大模型内在推理能力。EvoRAG在时空合规性与常识违规率上均优于基线方法,验证了结合网络知识与模型优化的可行性,为更可靠、自适应的旅行规划智能体提供新路径。
原文摘要 · Abstract (English)
Large language models (LLMs) have shown promise in automating travel planning, yet they often fall short in addressing nuanced spatiotemporal rationality. While existing benchmarks focus on basic plan validity, they neglect critical aspects such as route efficiency, POI appeal, and real-time adaptability. This paper introduces TP-RAG, the first benchmark tailored for retrieval-augmented, spatiotemporal-aware travel planning. Our dataset includes 2,348 real-world travel queries, 85,575 fine-grain annotated POIs, and 18,784 high-quality travel trajectory references sourced from online tourist documents, enabling dynamic and context-aware planning. Through extensive experiments, we reveal that integrating reference trajectories significantly improves spatial efficiency and POI rationality of the travel plan, while challenges persist in universality and robustness due to conflicting references and noisy data. To address these issues, we propose EvoRAG, an evolutionary framework that potently synergizes diverse retrieved trajectories with LLMs' intrinsic reasoning. EvoRAG achieves state-of-the-art performance, improving spatiotemporal compliance and reducing commonsense violation compared to ground-up and retrieval-augmented baselines. Our work underscores the potential of hybridizing Web knowledge with LLM-driven optimization, paving the way for more reliable and adaptive travel planning agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。