小模型通过分阶段压缩与优化,在边缘设备上实现更准的电池健康预测。
When Smaller Wins: Dual-Stage Distillation and Pareto-Guided Compression of Liquid Neural Networks for Edge Battery Prognostics
- 分两阶段蒸馏液态神经网络,保留时间动态并压缩模型。
- 部署后误差仅0.0066,比教师模型低15.4%,模型缩小84.7%。
- 适合资源受限的工业设备,如电池管理、嵌入式系统等场景。
电池管理系统在严格设备约束下需实现高精度电池健康状态预测。本文提出DLNet框架,通过液态神经网络的双阶段知识蒸馏,将大模型压缩为轻量级边缘可部署模型。首先采用欧拉离散化重构液态动力学以适配嵌入式环境;再执行双阶段蒸馏,转移并恢复教师模型的时间行为。基于误差-成本联合目标的帕累托选择保留兼顾准确率与效率的学生模型。在公开数据集上评估,并在Arduino Nano 33 BLE Sense设备上验证了int8部署可行性。最终部署模型在预测未来100个循环的电池健康时误差仅为0.0066,较教师模型降低15.4%;模型大小由616 kB降至94 kB(减少84.7%),单次推理耗时21 ms。结果支持‘小胜大’现象:经适当监督与筛选,小模型可在边缘预测任务中超越大模型。该框架亦可扩展至其他硬件受限的工业分析任务。
原文摘要 · Abstract (English)
Battery management systems increasingly require accurate battery health prognostics under strict on-device constraints. This paper presents DLNet, a practical framework with dual-stage distillation of liquid neural networks that turns a high-capacity model into compact and edge-deployable models for battery health prediction. DLNet first applies Euler discretization to reformulate liquid dynamics for embedded compatibility. It then performs dual-stage knowledge distillation to transfer the teacher model's temporal behavior and recover it after further compression. Pareto-guided selection under joint error-cost objectives retains student models that balance accuracy and efficiency. We evaluate DLNet on a widely used dataset and validate real-device feasibility on an Arduino Nano 33 BLE Sense using int8 deployment. The final deployed student achieves a low error of 0.0066 when predicting battery health over the next 100 cycles, which is 15.4% lower than the teacher model. It reduces the model size from 616 kB to 94 kB with 84.7% reduction and takes 21 ms per inference on the device. These results support a practical smaller wins observation that a small model can match or exceed a large teacher for edge-based prognostics with proper supervision and selection. Beyond batteries, the DLNet framework can extend to other industrial analytics tasks with strict hardware constraints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。