arXiv:2511.10561cs.LGcond-mat.mtrl-sci2025-11被引 5

用信息论方法压缩原子数据集,保留关键结构同时大幅降本。

Maximizing Efficiency of Dataset Compression for Machine Learning Potentials With Information Theory

  • 将数据压缩建模为最小集合覆盖问题,精准筛选核心原子环境。
  • 在高压缩率下仍保持数据多样性与力的长尾分布,优于传统方法。
  • 适合需要高效训练机器学习势的材料模拟研究者使用。

机器学习原子间势(MLIPs)在精度与计算成本间取得平衡,但性能依赖训练数据规模与多样性。大规模数据提升模型精度与泛化能力,但生成和训练成本高;小数据则可能丢弃稀有但关键的原子构型,影响准确性。本文提出基于信息论的框架,量化数据压缩效率,并设计一种最大化该效率的算法。将原子数据压缩转化为以原子为中心环境的最小集合覆盖(MSC)问题,识别出包含原数据最多信息的最小结构子集,同时剔除冗余信息。该方法在GAP-20和TM23数据集上验证,并在ColabFit库中64个不同数据集上测试。结果表明,MSC在高压缩率下始终保留异常值、维持数据多样性,准确重现力的长尾分布,优于其他采样方法。基于MSC压缩数据训练的MLIP在低数据量下对分布外数据误差更低。通过异常值分析解释结果,证明传统降维无法实现此类定量结论。算法已开源至QUESTS工具包,可用于数据子采样、异常检测及低成本优化MLIP训练。

原文摘要 · Abstract (English)

Machine learning interatomic potentials (MLIPs) balance high accuracy and lower costs compared to density functional theory calculations, but their performance often depends on the size and diversity of training datasets. Large datasets improve model accuracy and generalization but are computationally expensive to produce and train on, while smaller datasets risk discarding rare but important atomic environments and compromising MLIP accuracy/reliability. Here, we develop an information-theoretical framework to quantify the efficiency of dataset compression methods and propose an algorithm that maximizes this efficiency. By framing atomistic dataset compression as an instance of the minimum set cover (MSC) problem over atom-centered environments, our method identifies the smallest subset of structures that contains as much information as possible from the original dataset while pruning redundant information. The approach is extensively demonstrated on the GAP-20 and TM23 datasets, and validated on 64 varied datasets from the ColabFit repository. Across all cases, MSC consistently retains outliers, preserves dataset diversity, and reproduces the long-tail distributions of forces even at high compression rates, outperforming other subsampling methods. Furthermore, MLIPs trained on MSC-compressed datasets exhibit reduced error for out-of-distribution data even in low-data regimes. We explain these results using an outlier analysis and show that such quantitative conclusions could not be achieved with conventional dimensionality reduction methods. The algorithm is implemented in the open-source QUESTS package and can be used for several tasks in atomistic modeling, from data subsampling, outlier detection, and training improved MLIPs at a lower cost.

机器学习势数据压缩信息论原子模拟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。