测试边缘设备在故障下检测模型的硬件表现,发现系统仍稳定可靠。
Hardware Utilization and Inference Performance of Edge Object Detection Under Fault Injection
- 用大语言模型和扩散模型模拟故障,测试三款YOLO模型在边缘设备上的表现。
- 即使输入数据严重受损,GPU占用、温度和功耗仍保持稳定,内存释放规律一致。
- 适合关注边缘计算可靠性与模型鲁棒性的研究者和工程师参考。
随着深度学习模型在自动驾驶系统中部署于资源受限的边缘平台,了解硬件在资源退化下的行为变得至关重要。本文通过大规模故障注入实验,系统性地表征了在NVIDIA Jetson Nano上运行的TensorRT优化版YOLOv10s、YOLOv11s和YOLO2026n流水线在车道跟随与目标检测任务下的CPU负载、GPU利用率、内存消耗、功耗、吞吐量及热行为。故障由基于自研JetBot平台数据的解耦框架生成,利用大语言模型(LLMs)和潜在扩散模型(LDMs)。结果显示,两类任务下,推理引擎均维持稳定的GPU占用率,温升可控,功耗处于安全范围;内存使用在初始预热阶段后进入一致释放模式。目标检测任务在内存与热行为上略显波动,但总体表明:即便输入数据严重退化,TensorRT流水线依然表现稳健。这些发现为边缘推理的硬件可靠性提供了重要视角,补充了现有针对边缘推理性能的研究。
原文摘要 · Abstract (English)
As deep learning models are deployed on resource constrained edge platforms in autonomous driving systems, reli able knowledge of hardware behavior under resource degradation becomes an essential requirement. Therefore, we introduce a systematic characterization of CPU load, GPU utilization, RAM consumption, power draw, throughput, and thermal behaviour of TensorRT-optimized YOLOv10s, YOLOv11s and YOLO2026n pipelines running on NVIDIA Jetson Nano under a large-scale fault injection campaign targeting both lane-following and ob ject detection tasks. Faults are synthesized using a decoupled framework that leverages large language models (LLMs) and latent diffusion models (LDMs), based on original data from our JetBot platform data collection. Results show that across both tasks and both models the inference engines keep GPU occupancy stable, temperature rise under control, and power consumption within safe limits, while memory usage settles into a consistent release pattern after the initial warm-up phase. Object detection tends to show somewhat more variability in memory and thermal behavior, yet both tasks point to the same conclusion: the TensorRT pipelines hold up well even when the input data is heavily degraded. These findings offer a hardware-level view of model reliability that sits alongside, rather than against, the broader body of work focused on inference performance at the edge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。