用扩散模型实现多目标主动追踪,无需事先知道目标数量和状态。
MATT-Diff: Multimodal Active Target Tracking by Diffusion Policy
- 基于扩散模型生成多模态动作序列,融合视觉与目标不确定性信息。
- 在新环境中跟踪表现优于其他学习基线,可自动切换探索、追踪、重捕模式。
- 适合移动机器人在未知环境中的多目标追踪任务,开源代码可复现。
本文提出MATT-Diff:一种基于扩散策略的多模态主动多目标追踪控制方法,适用于移动智能体。该策略使代理能够自主切换探索、追踪和目标重捕等行为模式,且无需预先知晓目标数量、状态或动力学特性。有效追踪需平衡未检测/丢失目标的探索与已检测但不确定目标的不确定性降低。我们从三种专家规划器生成示范数据集:基于前沿的探索、结合前沿探索与RRT*追踪的不确定性混合规划器,以及基于时间切换探索与目标重捕的时序混合规划器。控制策略采用视觉变压器进行本体地图标记化,并通过注意力机制整合由高斯密度表示的可变目标估计。训练为扩散模型后,策略通过去噪过程学习生成多模态动作序列。评估表明,MATT-Diff在新环境中追踪性能显著优于其他学习基线,其多模态行为源自多个专家规划器。实现代码已开源:https://github.com/CINAPSLab/MATT-Diff。
原文摘要 · Abstract (English)
This paper proposes MATT-Diff: Multimodal Active Target Tracking by Diffusion Policy, a control policy for active multi-target tracking using a mobile agent. The policy enables multiple behavior modes for the agent, including exploration, tracking, and target reacquisition, without prior knowledge of the target numbers, states, or dynamics. Effective target tracking demands balancing exploration for undetected or lost targets with exploitation, i.e., uncertainty reduction, of detected but uncertain ones. We generate a demonstration dataset from three expert planners including frontier-based exploration, an uncertainty-based hybrid planner switching between frontier-based exploration and RRT* tracking, and a time-based hybrid planner switching between exploration and target reacquisition based on target detection time. Our control policy utilizes a vision transformer for egocentric map tokenization and an attention mechanism to integrate variable target estimates represented by Gaussian densities. Trained as a diffusion model, the policy learns to generate multimodal action sequences through a denoising process. Evaluations demonstrate MATT-Diff's superior tracking performance against other learning-based baselines in novel environments, as well as its multimodal behavior sourced from the multiple expert planners. Our implementation is available at https://github.com/CINAPSLab/MATT-Diff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。