多智能体水下探测中,兼顾协作效率与通信隐蔽性。
Joint Optimization of Cooperation Efficiency and Communication Covertness for Target Detection with AUVs
- 分层决策框架:宏观选任务,微观调轨迹与功率。
- 基于强化学习的自适应策略,在能耗与机动约束下运行。
- 适合水下隐蔽探测场景,提升多艘无人潜航器协同能力。
本文研究基于自主水下航行器(AUVs)的水下协同目标探测,重点关注协作效率与通信隐蔽性之间的关键权衡。为解决该问题,我们首先建立联合轨迹与功率控制优化模型,并提出一种创新的分层动作管理框架。在宏观层面,主AUV将代理选择过程建模为马尔可夫决策过程,采用近端策略优化算法进行战略任务分配;在微观层面,每个被选代理的分布式决策被建模为部分可观测马尔可夫决策过程,使用多智能体近端策略优化算法根据本地观测动态调整其轨迹与发射功率。在集中训练、分散执行范式下,本检测框架实现了满足能量与移动性约束的自适应隐蔽协作。通过全面建模系统、信号、任务及能耗,提供了关于多AUV高效安全运行的理论洞见与实用方案,对水下隐蔽通信任务具有重要指导意义。
原文摘要 · Abstract (English)
This paper investigates underwater cooperative target detection using autonomous underwater vehicles (AUVs), with a focus on the critical trade-off between cooperation efficiency and communication covertness. To tackle this challenge, we first formulate a joint trajectory and power control optimization problem, and then present an innovative hierarchical action management framework to solve it. According to the hierarchical formulation, at the macro level, the master AUV models the agent selection process as a Markov decision process and deploys the proximal policy optimization algorithm for strategic task allocation. At the micro level, each selected agent's decentralized decision-making is modeled as a partially observable Markov decision process, and a multi-agent proximal policy optimization algorithm is used to dynamically adjust its trajectory and transmission power based on its local observations. Under the centralized training and decentralized execution paradigm, our target detection framework enables adaptive covert cooperation while satisfying both energy and mobility constraints. By comprehensively modeling the considered system, the involved signals and tasks, as well as energy consumption, theoretical insights and practical solutions for the efficient and secure operation of multiple AUVs are provided, offering significant implications for the execution of underwater covert communication tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。