arXiv:2501.13994cs.CVcs.AI2025-01被引 2

多智能体协作追踪系统,让单设备实现高效动态目标跟踪。

CSAOT: Cooperative Multi-Agent System for Active Object Tracking

  • 用多智能体强化学习与专家混合框架,单设备协同决策。
  • 在动态障碍场景中提升追踪时长,抗遮挡与快速运动能力更强。
  • 无需额外设备,适合资源受限的机器人与安防应用。

目标跟踪在自动驾驶、监控和机器人等领域至关重要。与依赖固定视角的被动跟踪不同,主动目标跟踪(AOT)需控制器智能体主动调整视角以维持对移动目标的视觉接触。现有AOT方法多为单智能体,难以应对复杂动态环境,易因信息获取与处理能力有限导致决策不佳。为此,本文提出协作式主动目标跟踪系统(CSAOT),基于多智能体深度强化学习(MADRL)与专家混合(MoE)框架,使多个智能体在单个设备上协同工作,提升学习效率与鲁棒性。该方法有效增强对遮挡和快速运动的适应能力,并优化相机运动以延长追踪时间。我们在包含动态与静态障碍物的多种交互地图上验证了CSAOT的有效性。

原文摘要 · Abstract (English)

Object Tracking is essential for many computer vision applications, such as autonomous navigation, surveillance, and robotics. Unlike Passive Object Tracking (POT), which relies on static camera viewpoints to detect and track objects across consecutive frames, Active Object Tracking (AOT) requires a controller agent to actively adjust its viewpoint to maintain visual contact with a moving target in complex environments. Existing AOT solutions are predominantly single-agent-based, which struggle in dynamic and complex scenarios due to limited information gathering and processing capabilities, often resulting in suboptimal decision-making. Alleviating these limitations necessitates the development of a multi-agent system where different agents perform distinct roles and collaborate to enhance learning and robustness in dynamic and complex environments. Although some multi-agent approaches exist for AOT, they typically rely on external auxiliary agents, which require additional devices, making them costly. In contrast, we introduce the Collaborative System for Active Object Tracking (CSAOT), a method that leverages multi-agent deep reinforcement learning (MADRL) and a Mixture of Experts (MoE) framework to enable multiple agents to operate on a single device, thereby improving tracking performance and reducing costs. Our approach enhances robustness against occlusions and rapid motion while optimizing camera movements to extend tracking duration. We validated the effectiveness of CSAOT on various interactive maps with dynamic and stationary obstacles.

多智能体目标跟踪强化学习机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。