arXiv:2606.23725cond-mat.mtrl-scics.LG2026-06

机器学习预测钠离子电池电压时,计算参考值本身存在系统误差,导致模型验证失败。

Computational references are not experiments: pre-registered validation of machine-learned sodium-cathode voltages

  • 用预注册实验数据验证机器学习电压预测,发现模型错误主要来自计算参考值偏差。
  • 平均绝对误差达0.67 V,保守置信上限达1.09 V,误差随电压升高显著增加。
  • 揭示计算参考值比模型更不可靠,适合关注材料计算可信度的研究者阅读。

机器学习筛选电池材料几乎完全依赖计算参考电压,而这些参考值本身存在系统性误差。我们报告了一个量化案例:自研的图网络电压筛选系统(含先验筛选层与局部PBE+U基准)在预注册条件下未能通过以实验锚定的文献值验证。验证阈值、失败模式及主指标均在分析前确定。对已知钠离子正极材料的独立评估集(n=6,经一例排除后为n=7),原始保留测试集的平均绝对误差为0.67 V;预注册的保守指标——交叉验证偏差校正误差的95%置信上限为1.09 V;残差呈强电压依赖性(r = -0.94),表明无法通过加性校准修正。在两个可同时比较预测、数据库参考与实验值的化合物中,Materials Project的PBE+U参考值比实测值低约0.54 V,说明误差主要源自参考值而非模型。此前已有研究覆盖至少70%目标钠取代空间。因此,我们放弃该筛选系统,重新定义了其DFT数据库中“已验证”的标准,并预注册针对四个基准锂电偶的校准审计。

原文摘要 · Abstract (English)

Machine-learning screens for battery materials are trained and judged almost entirely against computed reference voltages, and those references carry their own systematic errors. We report a case in which this matters quantitatively: our own screening stack (a graph-network voltage screen, a prior-art triage layer, and a local PBE+U bench) fails pre-registered validation against experiment-anchored literature values. Verdict thresholds, failure modes, and the primary metric were committed before analysis. On an operator-audited set of known Na-ion cathodes (n = 6 after one documented exclusion; verdict unchanged at n = 7), the raw held-out mean absolute error was 0.67 V, the pre-registered conservative metric, the upper 95% confidence bound of the cross-validated bias-corrected error, was 1.09 V, and the residual was strongly voltage-dependent (r = -0.94), so no additive calibration is valid. On the two compounds where prediction, database reference, and experiment could all be compared, the Materials Project PBE+U reference sat about 0.54 V below measurement: the reference, not the model, dominated the error. A prior-art screen found at least 70% of the targeted Na substitution space already published. We retire the screen, bound what "verified" means for our DFT ledger, and pre-register a calibration audit of it against four benchmark Li couples.

电池材料计算化学机器学习误差分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。