arXiv:2512.20975cs.CV2025-12

用地图和大模型预测车辆跨摄像头轨迹,盲区追踪更准

SPOT!: Map-Guided LLM Agent for Unsupervised Multi-CCTV Dynamic Object Tracking

  • 用地图信息构建文档,实时查询车辆可能路径
  • 在盲区中准确预测车辆下一出现的摄像头,轨迹连续性提升
  • 无需训练,适合实际城市监控场景

基于CCTV的车辆追踪系统在多摄像头环境下难以持续连接同一车辆的轨迹,主要受限于摄像头间的盲区及视野有限,导致目标ID切换和轨迹丢失,降低实时路径预测可靠性。本文提出SPOT(Spatial Prediction Over Trajectories),一种无需预训练的地图引导大模型代理,可在多摄像头环境中实现车辆盲区追踪。方法将道路结构(Waypoints)与摄像头布设信息以2D坐标表示为文档,并通过分块技术组织,支持实时查询与推理。同时,利用视频中目标的相对位置与视野信息,将车辆位置转换至真实世界坐标系。结合地图空间信息、车辆行驶方向、速度与驾驶模式,在交叉口层级进行束搜索,推断车辆穿过盲区后最可能进入的摄像头区域。基于CARLA仿真器在虚拟城市环境中的实验表明,该方法能在盲区段准确预测车辆下一次出现的摄像头,显著优于现有技术,有效维持车辆轨迹连续性。

原文摘要 · Abstract (English)

CCTV-based vehicle tracking systems face structural limitations in continuously connecting the trajectories of the same vehicle across multiple camera environments. In particular, blind spots occur due to the intervals between CCTVs and limited Fields of View (FOV), which leads to object ID switching and trajectory loss, thereby reducing the reliability of real-time path prediction. This paper proposes SPOT (Spatial Prediction Over Trajectories), a map-guided LLM agent capable of tracking vehicles even in blind spots of multi-CCTV environments without prior training. The proposed method represents road structures (Waypoints) and CCTV placement information as documents based on 2D spatial coordinates and organizes them through chunking techniques to enable real-time querying and inference. Furthermore, it transforms the vehicle's position into the actual world coordinate system using the relative position and FOV information of objects observed in CCTV images. By combining map spatial information with the vehicle's moving direction, speed, and driving patterns, a beam search is performed at the intersection level to derive candidate CCTV locations where the vehicle is most likely to enter after the blind spot. Experimental results based on the CARLA simulator in a virtual city environment confirmed that the proposed method accurately predicts the next appearing CCTV even in blind spot sections, maintaining continuous vehicle trajectories more effectively than existing techniques.

多摄像头追踪大模型应用智能交通轨迹预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。