arXiv:2608.13826cond-mat.mtrl-scics.LG2026-08

通过注意力正则化提升材料结构-性能模型的可解释性

SPEAR: Structure Property Explainability with Attention Regularization

  • 引入可学习温度与平滑惩罚,约束注意力分布以增强稳定性
  • 在合成与实验数据上均实现与物理机制一致的连续注意力图谱
  • 适合需要可解释性的材料发现与结构分析研究者使用

机器学习在从光谱和衍射数据中学习结构-性能关系方面应用日益广泛,但其在材料发现中的应用常受限于模型预测的可解释性差。尽管注意力机制常被视为天然可解释,但未经正则化的注意力会产生不稳定、碎片化或受强度主导的归因模式,掩盖了物理成因。本文提出SPEAR(Structure Property Explainability with Attention Regularization),通过在训练中对注意力分布施加约束,提升其稳定性、选择性和物理可解释性。SPEAR在基于回归的注意力模型中引入可学习温度控制注意力集中度,并加入平滑惩罚项,使相邻光谱位置的注意力保持一致性,将注意力视为可学习的解释对象而非事后可视化工具。在具有已知生成机制的合成光谱基准测试中,正则化注意力生成了与因果特征一致的平滑、连续归因图谱,同时保持预测精度。应用于组合式稀土锆酸盐薄膜库的实验X射线衍射数据时,正则化模型能选择性强调物理相关的衍射特征,有效分离特征重要性与原始峰强度。所识别的220峰位置关联揭示了四方畸变与阳离子尺寸无序的适应性关系,以及局部热导率的相关性,促使我们重新评估早期结构分析。因此,注意力正则化为可解释的结构-性能回归提供了原则性训练约束,在不牺牲预测性能的前提下获得机制有意义的解释。

原文摘要 · Abstract (English)

Machine learning is increasingly used to learn structure property relationships from spectroscopic and diffraction data, yet its adoption in materials discovery is often limited by poor interpretability of model predictions. Although attention mechanisms are frequently treated as inherently explainable, unregularized attention can yield unstable, fragmented, or intensity driven attribution patterns that obscure the physical origin of these relationships. Here we introduce SPEAR (Structure Property Explainability with Attention Regularization), a framework that constrains attention distributions during training to improve their stability, selectivity, and physical interpretability. SPEAR augments attention based regression with a learnable temperature that controls attention concentration and a smoothness penalty that enforces coherence across neighboring spectral positions, treating attention as a learnable explanatory object rather than a post hoc visualization. Using synthetic spectral benchmarks with known generative structure, we show that attention regularization produces smooth, contiguous attribution profiles aligned with causal features while preserving predictive accuracy. Applied to experimental X ray diffraction data from a combinatorial rare earth zirconate thin film library, the regularized model selectively emphasizes physically relevant diffraction features and decouples feature importance from raw peak intensity. The reflection it identified prompted a reassessment of our earlier structural analysis, revealing a correlation between the 220 peak position, the tetragonal distortion that accommodates cation size disorder, and the local thermal conductivity. Attention regularization therefore provides a principled training constraint for explainable structure property regression, yielding mechanistically meaningful explanations without sacrificing predictive performance.

可解释性材料科学注意力机制结构-性能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。