arXiv:2507.07074cs.MAcs.RO2025-07

提出图模型评估多智能体任务难度,提升协作训练效率

Graph-Based Complexity Metrics for Multi-Agent Curriculum Learning: A Validated Approach to Task Ordering in Cooperative Coordination Environments

  • 用图结构整合依赖熵、干扰模式和目标重叠预测任务复杂度
  • 预测复杂度与实际难度相关性达0.952,显著提升训练效果
  • 适合多机器人协作场景的课程设计,尤其紧耦合任务

多智能体强化学习在任务排序与课程设计方面面临挑战,尤其在协作协调环境中。现有课程学习方法在单智能体领域成功,但缺乏针对多智能体协作的可验证任务复杂度度量。本文提出一种基于图的协调复杂度度量,融合智能体依赖熵、空间干扰模式和目标重叠分析,以预测多智能体环境中的任务难度。该度量在实证上验证有效,预测复杂度与随机智能体性能评估所得实际难度的相关系数为 rho = 0.952(p < 0.001)。在 MADDPG 框架下,于两个协调环境测试:在需要紧密协作的任务(MultiWalker)中实现 56 倍性能提升;在合作导航任务(Simple Spread)中展现系统性任务进展。分析表明,协调紧密度是课程学习有效性的预测因子,强依赖环境更受益于结构化推进。本研究提供可验证的复杂度度量,为多机器人协调应用建立实证指导。

原文摘要 · Abstract (English)

Multi-agent reinforcement learning (MARL) faces significant challenges in task sequencing and curriculum design, particularly for cooperative coordination scenarios. While curriculum learning has demonstrated success in single-agent domains, principled approaches for multi-agent coordination remain limited due to the absence of validated task complexity metrics. This approach presents a graph-based coordination complexity metric that integrates agent dependency entropy, spatial interference patterns, and goal overlap analysis to predict task difficulty in multi-agent environments. The complexity metric achieves strong empirical validation with rho = 0.952 correlation (p < 0.001) between predicted complexity and empirical difficulty determined by random agent performance evaluation. This approach evaluates the curriculum learning framework using MADDPG across two distinct coordination environments: achieving 56x performance improvement in tight coordination tasks (MultiWalker) and demonstrating systematic task progression in cooperative navigation (Simple Spread). Through systematic analysis, coordination tightness emerges as a predictor of curriculum learning effectiveness, where environments requiring strict agent interdependence benefit substantially from structured progression. This approach provides a validated complexity metric for multi-agent curriculum design and establishes empirical guidelines for multi-robot coordination applications.

多智能体课程学习复杂度度量协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。