针对车载环境温度变化,提出首个动态测试方法,发现并预警深度学习框架的运行缺陷。
GPU Temperature Simulation-Based Testing for In-Vehicle Deep Learning Frameworks
- 通过模拟极端温变下的GPU温度,动态调控频率以还原真实车载场景。
- 在-40℃至50℃温差下,检测出计算密集型算子延迟、精度错误和时序不同步问题。
- 适合自动驾驶系统开发者用于验证车载推理框架在高温/低温下的可靠性。
深度学习模型在自动驾驶系统中支撑环境感知等关键功能。为加速推理,其部署依赖车载深度学习框架(如Apollo中的PaddleInference和AutoWare中的TensorRT)。与云端部署不同,车载环境温度可在-40℃至50℃间剧烈波动,叠加计算产热导致GPU温度变化,进而触发DVFS等机制动态调整频率。然而,现有车载框架未考虑温度引起的频率波动影响。在温度变化的GPU上部署时,会出现严重质量问题:计算密集型算子延迟或报错,高/混合精度算子出现精度误差,时序型算子产生同步异常。现有测试方法无法发现这些问题,因其忽略了温度对框架质量的影响。为此,本文提出ThermalGuardian——首个面向温度变化环境的车载深度学习框架测试方法。该方法基于牛顿冷却定律模拟GPU温度波动,通过模型变异生成靶向敏感算子的测试输入,并根据实时温度控制GPU频率,实现真实场景下的质量评估。
原文摘要 · Abstract (English)
Deep learning models play a vital role in autonomous driving systems, supporting critical functions such as environmental perception. To accelerate model inference, these deep learning models' deployment relies on automotive deep learning frameworks, for example, PaddleInference in Apollo and TensorRT in AutoWare. However, unlike deploying deep learning models on the cloud, vehicular environments experience extreme ambient temperatures varying from -40°C to 50°C, significantly impacting GPU temperature. Additionally, heats generated when computing further lead to the GPU temperature increase. These temperature fluctuations lead to dynamic GPU frequency adjustments through mechanisms such as DVFS. However, automotive deep learning frameworks are designed without considering the impact of temperature-induced frequency variations. When deployed on temperature-varying GPUs, these frameworks suffer critical quality issues: compute-intensive operators face delays or errors, high/mixed-precision operators suffer from precision errors, and time-series operators suffer from synchronization issues. The above quality issues cannot be detected by existing deep learning framework testing methods because they ignore temperature's effect on the deep learning framework quality. To bridge this gap, we propose ThermalGuardian, the first automotive deep learning framework testing method under temperature-varying environments. Specifically, ThermalGuardian generates test input models using model mutation rules targeting temperature-sensitive operators, simulates GPU temperature fluctuations based on Newton's law of cooling, and controls GPU frequency based on real-time GPU temperature.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。