将复杂无人机任务分解为可并行求解的子问题,实现高效实时决策。
A Novel MDP Decomposition Framework for Scalable UAV Mission Planning in Complex and Uncertain Environments
- 用目标优先级等特征将大MDP拆成多个小子MDP
- 计算时间降低数量级,且策略最优性与可靠性不变
- 适合需要实时响应的复杂环境无人机任务规划
本文提出一种可扩展且容错的无人飞行器(UAV)任务管理框架,用于复杂不确定环境。针对大规模马尔可夫决策过程(MDP)求解的计算瓶颈,提出两阶段分解策略:第一阶段基于目标优先级、故障状态、空间布局和能量约束等领域特征,采用因子算法将全局MDP分解为多个目标特定的子MDP;第二阶段通过优先级重组合算法独立求解各子MDP,并利用元策略进行冲突协调,整合为统一全局策略。理论分析表明,在弱概率独立假设下,合成策略与全局最优MDP策略在数学上等价。大量仿真验证了该方法的有效性,计算时间减少数个数量级,同时保持任务可靠性与策略最优性。该框架为实时无人机任务执行提供了可扩展、鲁棒的决策基础。
原文摘要 · Abstract (English)
This paper presents a scalable and fault-tolerant framework for unmanned aerial vehicle (UAV) mission management in complex and uncertain environments. The proposed approach addresses the computational bottleneck inherent in solving large-scale Markov Decision Processes (MDPs) by introducing a two-stage decomposition strategy. In the first stage, a factor-based algorithm partitions the global MDP into smaller, goal-specific sub-MDPs by leveraging domain-specific features such as goal priority, fault states, spatial layout, and energy constraints. In the second stage, a priority-based recombination algorithm solves each sub-MDP independently and integrates the results into a unified global policy using a meta-policy for conflict resolution. Importantly, we present a theoretical analysis showing that, under mild probabilistic independence assumptions, the combined policy is provably equivalent to the optimal global MDP policy. Our work advances artificial intelligence (AI) decision scalability by decomposing large MDPs into tractable subproblems with provable global equivalence. The proposed decomposition framework enhances the scalability of Markov Decision Processes, a cornerstone of sequential decision-making in artificial intelligence, enabling real-time policy updates for complex mission environments. Extensive simulations validate the effectiveness of our method, demonstrating orders-of-magnitude reduction in computation time without sacrificing mission reliability or policy optimality. The proposed framework establishes a practical and robust foundation for scalable decision-making in real-time UAV mission execution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。