实测发现边缘推理性能在真实场景中会大幅下降,该研究提出稳定方案提升持续感知效果。
Beyond Benchmarks: Continuous Edge Inference for Fine-Grained Roadside Perception

- 设计时序稳定机制,提升连续视频流中的推理一致性。
- 真实道路部署中性能下降20%-30%,系统恢复超10%分类准确率。
- 适合关注边缘持续运行的自动驾驶与智能交通开发者。
资源受限的边缘硬件上进行持续人工智能推理会引入传统基准测试难以察觉的部署效应,包括视频流中的时间不稳定性、长时间负载下的温度降频,以及工作负载依赖的性能波动。我们提出了Edge-TSR,一个面向部署的持续路边感知边缘推理系统,运行于NVIDIA Jetson Orin Nano设备。Edge-TSR集成检测、跟踪、细粒度分类,并引入轻量级轨迹感知时序稳定机制,在几乎无额外计算开销下提升流式推理一致性。核心发现是:以基准为中心的评估方法系统性高估了实际部署性能。在三个前沿基线模型上,从静态图像评估转为真实流式部署时均出现20%-30%相对性能下降。Edge-TSR通过时序推理稳定化,相比逐帧推理基线最高恢复10.16%分类准确率,同时保持持续实时运行。我们在多种真实部署条件下评估系统,综合分析推理质量、延迟、吞吐与热行为。一次55分钟、26公里的车载部署表明,单个嵌入式设备在无云端卸载情况下,可持续运行于16.18 FPS且处于安全温控范围内。结果表明,部署感知评估与时序推理稳定化是真实世界传感部署中持续运行边缘AI系统的必要组成部分。我们发布了一个带标注的流式视频评估数据集及完整系统实现,支持可复现的部署导向评估。
原文摘要 · Abstract (English)
Continuous AI inference on resource-constrained edge hardware introduces deployment effects that are largely invisible to conventional benchmark evaluation, including temporal instability in streaming video, thermal throttling under sustained load, and workload-dependent performance variability. We present Edge-TSR, a deployment-oriented continuous edge inference system for sustained roadside perception on the NVIDIA Jetson Orin Nano. Edge-TSR integrates detection, tracking, fine-grained classification, and a lightweight track-aware temporal stabilization mechanism that improves streaming inference consistency with negligible computational overhead. Our central finding is that benchmark-centric evaluation systematically overstates deployed edge inference performance. Across three state-of-the-art baselines, we observe consistent 20-30% relative degradation when transitioning from static-image evaluation to real-world streaming deployment. Edge-TSR addresses this gap through temporal inference stabilization, recovering up to 10.16% classification accuracy over per-frame inference baselines while maintaining sustained real-time performance under continuous operation. We evaluate the complete system under diverse real-world deployment conditions, jointly characterizing inference quality, latency, throughput, and thermal behavior during long-duration operation. A 55-minute vehicular deployment over a 26 km route demonstrates sustained operation at 16.18 FPS within safe thermal limits on a single embedded device without cloud offload. Our findings show that deployment-aware evaluation and temporal inference stabilization are necessary components of continuously operating edge AI systems intended for real-world sensing deployments. We release a sample annotated streaming video evaluation dataset and full system implementation to support reproducible deployment-centric evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。