arXiv:2508.19866cs.CVcs.LG2025-08被引 2

融合轨迹与视觉信息,提升行人过街意图预测精度

TrajFusionNet: Pedestrian Crossing Intention Prediction via Fusion of Sequential and Visual Trajectory Representations

  • 用双分支网络分别处理序列与视觉轨迹信息
  • 在三个主流数据集上达到最优性能
  • 轻量设计使推理速度领先同类模型

随着自动驾驶车辆进入公共道路,预测行人过街意图成为研究热点。该任务旨在判断场景中的行人是否可能过马路。本文提出TrajFusionNet,一种基于Transformer的新型模型,将未来行人轨迹和车辆速度预测作为先验信息,用于意图判断。模型包含两个分支:序列注意力模块(SAM)学习观测及预测的行人轨迹与车辆速度序列;视觉注意力模块(VAM)通过将预测的行人边界框叠加在场景图像上,实现对视觉轨迹的建模。凭借少量轻量级模态,TrajFusionNet在当前最先进方法中实现最低总推理时延(含模型运行与预处理时间)。在行人过街意图预测三大常用数据集上,其性能均达最优水平。

原文摘要 · Abstract (English)

With the introduction of vehicles with autonomous capabilities on public roads, predicting pedestrian crossing intention has emerged as an active area of research. The task of predicting pedestrian crossing intention involves determining whether pedestrians in the scene are likely to cross the road or not. In this work, we propose TrajFusionNet, a novel transformer-based model that combines future pedestrian trajectory and vehicle speed predictions as priors for predicting crossing intention. TrajFusionNet comprises two branches: a Sequence Attention Module (SAM) and a Visual Attention Module (VAM). The SAM branch learns from a sequential representation of the observed and predicted pedestrian trajectory and vehicle speed. Complementarily, the VAM branch enables learning from a visual representation of the predicted pedestrian trajectory by overlaying predicted pedestrian bounding boxes onto scene images. By utilizing a small number of lightweight modalities, TrajFusionNet achieves the lowest total inference time (including model runtime and data preprocessing) among current state-of-the-art approaches. In terms of performance, it achieves state-of-the-art results across the three most commonly used datasets for pedestrian crossing intention prediction.

行人意图预测多模态融合Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。