用真实航班数据验证并修正大模型生成的行程时间矛盾。
Iti-Validator: A Guardrail Framework for Validating and Correcting LLM-Generated Itineraries
- 接入AeroDataBox API，用真实航程数据检验行程逻辑。
- 发现大模型生成行程常有时间冲突、转机不合理等问题。
- 可系统性修复时间错误，适合旅行规划类应用落地。
大型语言模型（LLMs）已能生成复杂多步行程计划，但往往缺乏时间与空间一致性，尤其在涉及实际出行约束时。本研究分析不同LLMs在时间推理上的表现，提出一个验证框架，用于评估并改进LLM生成的旅行行程在时间上的一致性。系统调用多个前沿LLMs生成行程，并通过AeroDataBox API对比真实航班时长进行校验。实验表明，当前LLMs频繁生成时间不一致的行程，但可通过该框架被系统、可靠地修正，使行程可在大规模旅行规划中实用化部署。
原文摘要 · Abstract (English)
The rapid advancement of Large Language Models (LLMs) has enabled them to generate complex, multi-step plans and itineraries. However, these generated plans often lack temporal and spatial consistency, particularly in scenarios involving physical travel constraints. This research aims to study the temporal performance of different LLMs and presents a validation framework that evaluates and improves the temporal consistency of LLM-generated travel itineraries. The system employs multiple state-of-the-art LLMs to generate travel plans and validates them against real-world flight duration constraints using the AeroDataBox API. This work contributes to the understanding of LLM capabilities in handling complex temporal reasoning tasks like itinerary generation and provides a framework to rectify any temporal inconsistencies like overlapping journeys or unrealistic transit times in the itineraries generated by LLMs before the itinerary is given to the user. Our experiments reveal that while current LLMs frequently produce temporally inconsistent itineraries, these can be systematically and reliably corrected using our framework, enabling their practical deployment in large-scale travel planning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。