arXiv:2510.00405cs.CVcs.AI2025-10被引 7

针对第一视角观测噪声,提出新基准与鲁棒轨迹预测模型。

EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observations

  • 双流流匹配模型同时去噪历史观测并预测未来轨迹
  • 在真实场景下将最小ADE和FDE降低10%-15%
  • 适合需要应对遮挡、目标错连等视觉干扰的机器人导航任务

从第一人称视角进行可靠的轨迹预测对人机共存环境中的机器人导航至关重要。然而,现有方法通常假设观测历史无噪声,未考虑第一人称视觉固有的感知误差,如遮挡、身份切换和跟踪漂移。这种训练假设与实际部署环境之间的差距严重限制了模型鲁棒性。为此,我们提出EgoTraj-Bench,基于TBD数据集构建首个真实世界基准,将带有噪声的第一人称视觉历史与清晰的鸟瞰图未来轨迹对齐,支持在现实感知约束下的鲁棒学习。在此基准上,我们提出BiFlow,一种双流流匹配模型,可同时对历史观测去噪并预测未来运动。为更好地建模代理意图,BiFlow引入EgoAnchor机制,通过特征调制将提炼的历史特征条件化到预测解码器。大量实验表明,BiFlow在平均意义上将minADE和minFDE降低10%-15%,表现出卓越鲁棒性。我们期望该基准与模型能为真实世界第一人称轨迹预测提供关键基础。基准库地址:https://github.com/zoeyliu1999/EgoTraj-Bench。

原文摘要 · Abstract (English)

Reliable trajectory prediction from an ego-centric perspective is crucial for robotic navigation in human-centric environments. However, existing methods typically assume noiseless observation histories, failing to account for the perceptual artifacts inherent in first-person vision, such as occlusions, ID switches, and tracking drift. This discrepancy between training assumptions and deployment reality severely limits model robustness. To bridge this gap, we introduce EgoTraj-Bench, built upon TBD dataset, which is the first real-world benchmark that aligns noisy, first-person visual histories with clean, bird's-eye-view future trajectories, enabling robust learning under realistic perceptual constraints. Building on this benchmark, we propose BiFlow, a dual-stream flow matching model that concurrently denoises historical observations and forecasts future motion. To better model agent intent, BiFlow incorporates our EgoAnchor mechanism, which conditions the prediction decoder on distilled historical features via feature modulation. Extensive experiments show that BiFlow achieves state-of-the-art performance, reducing minADE and minFDE by 10-15% on average and demonstrating superior robustness. We anticipate that our benchmark and model will provide a critical foundation for robust real-world ego-centric trajectory prediction. The benchmark library is available at: https://github.com/zoeyliu1999/EgoTraj-Bench.

轨迹预测第一人称视角去噪机器人导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。