用BERT思想做电池故障检测,自监督学习提升准确率。
BatteryBERT for Realistic Battery Fault Detection Using Point-Masked Signal Modeling
- 将BERT改为时间序列专用,用掩码信号建模自监督训练
- 在真实数据上达0.945的AUROC,显著优于现有方法
- 适合做工业电池健康监测的工程师和研究者
锂离子电池的精确故障检测对电动汽车和储能系统的安全可靠运行至关重要。现有方法难以捕捉复杂的时间依赖关系,且未能充分利用大量未标注数据。尽管大语言模型具备强大的表征能力,但其架构不适用于工业场景中的数值时间序列数据。为此,我们提出一种新框架:通过引入定制的时间序列转令牌模块和面向电池应用的点级掩码信号建模(point-MSM)预训练任务,扩展标准BERT架构,实现对充放电周期中电流、电压等序列数据的自监督学习,获得分布鲁棒、上下文感知的时间嵌入。随后将这些嵌入与电池元数据拼接,输入下游分类器进行故障分类。在大规模真实数据集上的实验表明,使用预训练参数初始化的模型显著提升表征质量和分类准确率,达到0.945的AUROC,明显优于现有方法。结果验证了BERT式预训练在时间序列故障检测中的有效性。
原文摘要 · Abstract (English)
Accurate fault detection in lithium-ion batteries is essential for the safe and reliable operation of electric vehicles and energy storage systems. However, existing methods often struggle to capture complex temporal dependencies and cannot fully leverage abundant unlabeled data. Although large language models (LLMs) exhibit strong representation capabilities, their architectures are not directly suited to the numerical time-series data common in industrial settings. To address these challenges, we propose a novel framework that adapts BERT-style pretraining for battery fault detection by extending the standard BERT architecture with a customized time-series-to-token representation module and a point-level Masked Signal Modeling (point-MSM) pretraining task tailored to battery applications. This approach enables self-supervised learning on sequential current, voltage, and other charge-discharge cycle data, yielding distributionally robust, context-aware temporal embeddings. We then concatenate these embeddings with battery metadata and feed them into a downstream classifier for accurate fault classification. Experimental results on a large-scale real-world dataset show that models initialized with our pretrained parameters significantly improve both representation quality and classification accuracy, achieving an AUROC of 0.945 and substantially outperforming existing approaches. These findings validate the effectiveness of BERT-style pretraining for time-series fault detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。