发现分子模型中多数张量表示未被利用,优化后性能提升
Deconstructing equivariant representations in molecular systems
- 用图卷积模型分析量子化学数据集中的对称表示
- 训练时忽略向量和张量类表示,但不影响测试指标
- 移除冗余球谐函数可提升模型表现与潜在空间结构
近期等变模型在化学性质预测及分子材料动力学模拟中表现优异,多数高性能模型基于张量积框架,通过限制对称性允许的交互保持等变性。然而,对这些等变表示中保留的信息及其在基准指标外的行为缺乏深入理解。本文在QM9数据集上使用简单等变图卷积模型,研究量化性能与分子图嵌入之间的关联。关键发现是:在标量预测任务中,训练过程会忽略许多不可约表示,特别是矢量(l=1)和张量(l=2)量;这一问题不会反映在测试指标上。实验表明,移除部分未使用的球谐函数阶数能提升模型性能,并改善潜在空间结构。基于此,提出了若干改进未来实验效率与等变特征利用率的建议。
原文摘要 · Abstract (English)
Recent equivariant models have shown significant progress in not just chemical property prediction, but as surrogates for dynamical simulations of molecules and materials. Many of the top performing models in this category are built within the framework of tensor products, which preserves equivariance by restricting interactions and transformations to those that are allowed by symmetry selection rules. Despite being a core part of the modeling process, there has not yet been much attention into understanding what information persists in these equivariant representations, and their general behavior outside of benchmark metrics. In this work, we report on a set of experiments using a simple equivariant graph convolution model on the QM9 dataset, focusing on correlating quantitative performance with the resulting molecular graph embeddings. Our key finding is that, for a scalar prediction task, many of the irreducible representations are simply ignored during training -- specifically those pertaining to vector ($l=1$) and tensor quantities ($l=2$) -- an issue that does not necessarily make itself evident in the test metric. We empirically show that removing some unused orders of spherical harmonics improves model performance, correlating with improved latent space structure. We provide a number of recommendations for future experiments to try and improve efficiency and utilization of equivariant features based on these observations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。