PBT模型通过预训练实现跨电池类型的寿命预测,解决数据少、差异大的难题。
Pretrained battery transformer (PBT): A foundation model for battery life prediction
- 采用混合专家架构融合多源异构电池数据,构建通用预训练模型
- 在15个数据集上平均性能领先竞品21.9%,最高提升86.9%
- 适用于小样本场景,为可持续能源领域提供可迁移的预测基础
早期预测电池循环寿命对改进电池设计、制造和部署至关重要。尽管机器学习取得进展,但电池寿命预测仍受限于数据稀缺以及电池化学体系、规格、成型工艺和工作条件间的显著异质性。虽然迁移学习被广泛探索以缓解此问题,但其效果受限于缺乏能整合异构电池寿命数据并提供通用知识的基础模型。本文提出预训练电池变压器(PBT),一种用于电池寿命预测的基础模型,通过电池知识编码的混合专家层从稀缺且异构的寿命数据中学习。PBT首先在13个锂离子电池数据集上进行预训练,生成具备全面寿命知识的通用模型,再通过迁移学习适配至目标场景的专用模型。在涵盖977块电池和528组老化条件的15个数据集上,包括锂离子、钠离子和锌离子电池,PBT表现达到当前最优水平,平均超越最强对比方法21.9%,最高提升达86.9%。本研究首次建立电池寿命预测的基础模型,推动该任务从孤立的、场景特定的建模向可复用的知识基础转变,为其他具有稀缺性和异质性数据特征的可持续能源预测问题提供借鉴。
原文摘要 · Abstract (English)
Early prediction of battery cycle life is essential for improving battery design, manufacturing and deployment. However, despite encouraging progress with machine learning, battery life prediction remains constrained by scarce data and pronounced heterogeneity across battery chemistries, specifications, formation protocols and operating conditions. Although transfer learning has been widely explored to alleviate these challenges, its effectiveness is limited by the absence of a foundation model that can integrate heterogeneous battery life data and provide broadly useful knowledge for target-scenario specialization. Here we introduce the pretrained battery transformer (PBT), a foundation model for battery life prediction that incorporates battery-knowledge-encoded mixture-of-experts layers to learn from scarce and heterogeneous lifetime data. PBT is first pretrained on 13 lithium-ion battery datasets to yield a general PBT that encodes comprehensive battery lifetime knowledge, and is then adapted through transfer learning into specialized PBT models for target scenarios. Across 15 datasets covering 977 batteries and 528 sets of aging conditions from lithium-ion, sodium-ion and zinc-ion batteries, PBT achieves state-of-the-art performance, surpassing the strongest competing method by 21.9% on average, with gains of up to 86.9%. This study establishes, to our knowledge, the first foundation model for battery life prediction and provides a step towards shifting battery lifetime prediction from isolated, scenario-specific modelling tasks to a reusable knowledge foundation that can be specialized to target scenarios with limited data, with implications for other prediction problems characterized by scarce and heterogeneous data in sustainable energy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。