arXiv:2512.09514cond-mat.mtrl-scics.LG2025-12被引 3

提出新评估指标TNovD,同时衡量材料生成模型的质量与新颖性。

Transport Novelty Distance: A Distributional Metric for Evaluating Material Generative Models

  • 基于最优传输理论,通过特征耦合判断生成结构质量与记忆程度。
  • 在MP20和WBM数据集上可检测出记忆数据与低质量结构。
  • 适用于材料、图像、分子等多领域生成模型评估。

生成式机器学习的进展为新材料发现与设计带来了新可能。然而,随着模型日益复杂,亟需严谨且有意义的评估指标。现有方法往往无法同时捕捉生成结构的质量与新颖性,制约了对生成性能的真实评估。本文提出运输新颖性距离(TNovD),通过最优传输理论中的特征耦合机制,结合阈值划分质量与记忆区域,联合评估生成材料的质量与新颖性。特征由图神经网络提取,该网络通过对比学习训练以区分材料、其增强样本及不同尺寸超胞。我们在晶体结构预测的典型实验(如记忆测试、噪声注入、晶格形变)中验证该方法,并在MP20验证集与WBM取代数据集上展示了其识别记忆与低质量数据的能力。同时对多个主流材料生成模型进行了基准测试。尽管专为材料设计,但该框架具有领域无关性,可推广至图像、分子等领域。

原文摘要 · Abstract (English)

Recent advances in generative machine learning have opened new possibilities for the discovery and design of novel materials. However, as these models become more sophisticated, the need for rigorous and meaningful evaluation metrics has grown. Existing evaluation approaches often fail to capture both the quality and novelty of generated structures, limiting our ability to assess true generative performance. In this paper, we introduce the Transport Novelty Distance (TNovD) to judge generative models used for materials discovery jointly by the quality and novelty of the generated materials. Based on ideas from Optimal Transport theory, TNovD uses a coupling between the features of the training and generated sets, which is refined into a quality and memorization regime by a threshold. The features are generated from crystal structures using a graph neural network that is trained to distinguish between materials, their augmented counterparts, and differently sized supercells using contrastive learning. We evaluate our proposed metric on typical toy experiments relevant for crystal structure prediction, including memorization, noise injection and lattice deformations. Additionally, we validate the TNovD on the MP20 validation set and the WBM substitution dataset, demonstrating that it is capable of detecting both memorized and low-quality material data. We also benchmark the performance of several popular material generative models. While introduced for materials, our TNovD framework is domain-agnostic and can be adapted for other areas, such as images and molecules.

生成模型材料发现评估指标最优传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。