用大模型生成真实空管指令,发现越简单的提示效果越好。
Air Traffic Control Using Large Language Models: Prompt Engineering, Architecture, and Evaluation

- 设计五种提示结构,让大模型在对话中扮演空管角色。
- 最宽松的提示表现最佳,严格限制反而导致错误累积崩溃。
- 适合对航空安全与AI交互感兴趣的工程师和研究者。
空中交通管制(ATC)通信是高度依赖人工的安全关键对话,尽管其他空管环节已部分自动化。本文实验评估大语言模型(LLM)生成操作上真实的空管指令的能力。以旧金山“海湾观光”航线的一次通用航空飞行为基准(P0),通过人机协同方式手写转录作为真实参考。设计五种逐步增加约束的提示结构(P1-P5),嵌入状态化多轮对话管道中,模型基于累积对话历史向固定飞行员转录文本发出指令。在九个开源与闭源的LLM上测试不同提示、是否使用另一飞行任务的示范转录作为上下文示例,以及模型是否依赖自身历史或注入真实历史。通过词汇、结构、语义相似度指标及经专家标注验证的GPT-5.5评分系统进行评估。结果显示:提供示范转录可提升相似度,但强化提示无效——最宽松提示表现最优,最严格提示因自身错误积累而崩溃,注入正确历史可修复该问题。这些结果勾勒出实现大模型辅助空管的可行路径及其当前局限。
原文摘要 · Abstract (English)
Air traffic control (ATC) communication is a safety-critical dialogue that remains largely human-driven even as other parts of air traffic management have been semi-automated. In this article, we experimentally evaluate whether large language models (LLMs) can generate operationally realistic ATC transmissions. An experimental general-aviation flight flying over the San Francisco "Bay Tour" route is hand-transcribed and used as ground truth (P0). Through a pilot-in-the-loop process we design five prompt structures (P1-P5) of increasing constraint and embed them in a stateful multi-turn pipeline, where the model plays ATC to a fixed pilot transcript while conditioning on the accumulating dialogue history. Across nine open- and closed-source LLMs we vary the prompt, the presence of a worked transcript from a different experimental flight as an in-context example, and whether the model conditions on its own prior replies or on injected ground-truth history. Turns are scored with lexical, structural, and semantic similarity metrics and by an LLM-as-judge (GPT-5.5) validated against human expert annotation. Supplying a worked example improves similarity, but tightening the prompt does not: the lightest prompts perform best and the most heavily scripted one collapses as its own errors accumulate through the dialogue, which injecting correct history repairs. These results outline a concrete path and its current limits toward LLM-assisted ATC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。