用强化学习实现无人航空器在走廊网中的去中心化调度
Decentralized Autonomous Traffic Management through Corridor Networks

- 基于多智能体强化学习,仅需局部协调即可完成飞行管理
- 零样本迁移至复杂走廊网络,性能稳定且无需重训练
- 适合高密度空域管理,尤其适用于自主飞行器规模化场景
随着自主飞行器大规模引入及交通密度上升,集中式管理难以应对大量有人与无人航空器的协同。为此,提出了专用先进空中交通(AAM)走廊以组织高密度自主飞行流。为实现可扩展的轨迹规划灵活性,本文拓展了多智能体强化学习(MARL)方法,用于解决AAM走廊网络中的去中心化交通流管理问题。我们在单走廊训练的策略,以零样本方式测试于包含合并与分流的复杂多走廊网络。实验表明,所学行为能良好迁移到不同交通密度、网络几何结构和异构飞行器性能场景中,无需中央协调或模型重训。系统性能评估涵盖航路边界符合度、任务完成率、平均速度、飞行距离及机间安全间隔维持。结果表明,尽管策略仅要求局部协调进出与穿越行为,却能集体生成理想的走廊网络交通流。
原文摘要 · Abstract (English)
As autonomous aircraft are introduced at scale and traffic density increases, centralized management becomes insufficient to coordinate the large numbers of crewed and uncrewed aircraft. Dedicated Advanced Air Mobility (AAM) corridors have therefore been proposed for organizing high-density autonomous traffic flows. The desire to scalably provide autonomous aircraft flexibility in trajectory planning motivates the development of decentralized approaches to traffic management in AAM corridors. In this work, we extend a multi-agent reinforcement learning (MARL) approach to address the challenge of decentralized traffic flow management in air corridor networks. We test policies trained in a single-corridor setting on increasingly complex multi-corridor networks with combinations of merges and splits in a zero-shot manner. Experimental results demonstrate that learned behaviors transfer well to scenarios with varying traffic density, network geometry, and heterogeneous vehicle performance, without needing centralized coordination or model retraining. We evaluate system-level performance in terms of conformance to corridor boundaries, completion rates, average speeds, distance traveled, and maintenance of inter-aircraft separation. We find that although our policies require only locally coordinated entry, traversal, and exit behaviors, they collectively produce desirable traffic flows through the corridor network.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。