用三个小模型提升车载追踪精度,实时且可插拔。
Tiny Neural Networks for Multi-Object Tracking in a Modular Kalman Framework
- 设计三个小于5万参数的专用小网络,分别替代传统追踪中的运动预测、单目标匹配和多目标联合匹配。
- 在KITTI数据集上,预测误差降低超50%,匹配准确率达95%。
- 模块化设计,可独立训练评估,适合嵌入式车载系统部署。
我们提出一种模块化、可投入生产的方案,将紧凑型神经网络集成到基于卡尔曼滤波的多目标跟踪(MOT)流程中。设计了三个微型任务专用网络以保持模块化、可解释性及实时适用性,适用于嵌入式汽车辅助驾驶系统:(i) SPENT(单预测网络)——预测每条轨迹状态,取代卡尔曼滤波器中使用的启发式运动模型;(ii) SANT(单关联网络)——将单个传感器目标分配给现有轨迹,不依赖启发式距离与关联度量;(iii) MANTa(多关联网络)——一步完成多个传感器目标与多个轨迹的联合关联。每个模块参数少于5万。此外,三者均可实时运行,基于追踪数据训练,并提供模块化接口,可无缝集成标准卡尔曼滤波状态更新与轨迹管理。这使其具备即插即用特性,兼容多种现有追踪器。模块化通过各网络独立训练与评估得以保证。在KITTI追踪基准上的评估显示,SPENT使预测均方根误差(RMSE)降低超过50%,而SANT与MANTa达到最高95%的关联准确率。结果表明,小型、任务专用的神经模块可在不牺牲模块化、可解释性或实时性前提下,显著提升追踪精度与鲁棒性。
原文摘要 · Abstract (English)
We present a modular, production-ready approach that integrates compact Neural Network (NN) into a Kalmanfilter-based Multi-Object Tracking (MOT) pipeline. We design three tiny task-specific networks to retain modularity, interpretability and eal-time suitability for embedded Automotive Driver Assistance Systems: (i) SPENT (Single-Prediction Network) - predicts per-track states and replaces heuristic motion models used by the Kalman Filter (KF). (ii) SANT (Single-Association Network) - assigns a single incoming sensor object to existing tracks, without relying on heuristic distance and association metrics. (iii) MANTa (Multi-Association Network) - jointly associates multiple sensor objects to multiple tracks in a single step. Each module has less than 50k trainable parameters. Furthermore, all three can be operated in real-time, are trained from tracking data, and expose modular interfaces so they can be integrated with standard Kalman-filter state updates and track management. This makes them drop-in compatible with many existing trackers. Modularity is ensured, as each network can be trained and evaluated independently of the others. Our evaluation on the KITTI tracking benchmark shows that SPENT reduces prediction RMSE by more than 50% compared to a standard Kalman filter, while SANT and MANTa achieve up to 95% assignment accuracy. These results demonstrate that small, task-specific neural modules can substantially improve tracking accuracy and robustness without sacrificing modularity, interpretability, or the real-time constraints required for automotive deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。