用可微信息不平衡法自动选特征并加权,让分子系统分析更准确可解释。
Automatic feature selection and weighting in molecular systems using Differentiable Information Imbalance
- 通过可微信息不平衡度量特征间关系,自动排序和筛选关键特征。
- 在两个分子基准任务中,成功识别出描述构象的协同变量与力场训练特征。
- 支持单位对齐、重要性加权,且能自动确定最优降维维度,适合科研人员使用。
特征选择在分子系统分析中至关重要,但仍有诸多不确定性:简化模型应保留多少特征才足够?不同单位的特征如何对齐?相对重要性如何加权?本文提出可微信息不平衡(DII),一种用于评估特征集间信息含量差异的自动化方法。基于真实特征空间中的距离,DII识别出能最好保留这些关系的低维特征子集。每个特征通过权重缩放,权重通过梯度下降最小化DII进行优化,实现单位对齐与重要性加权的同时保持可解释性。DII还能生成稀疏解并确定最优特征空间大小。我们在两个分子基准问题上验证了该方法的有效性:(1) 识别描述生物分子构象的协同变量;(2) 为机器学习力场训练选取特征。结果表明DII在解决特征选择挑战和优化维度方面具有潜力。该方法已开源至Python库DADApy。
原文摘要 · Abstract (English)
Feature selection is essential in the analysis of molecular systems and many other fields, but several uncertainties remain: What is the optimal number of features for a simplified, interpretable model that retains essential information? How should features with different units be aligned, and how should their relative importance be weighted? Here, we introduce the Differentiable Information Imbalance (DII), an automated method to rank information content between sets of features. Using distances in a ground truth feature space, DII identifies a low-dimensional subset of features that best preserves these relationships. Each feature is scaled by a weight, which is optimized by minimizing the DII through gradient descent. This allows simultaneously performing unit alignment and relative importance scaling, while preserving interpretability. DII can also produce sparse solutions and determine the optimal size of the reduced feature space. We demonstrate the usefulness of this approach on two benchmark molecular problems: (1) identifying collective variables that describe conformations of a biomolecule, and (2) selecting features for training a machine-learning force field. These results show the potential of DII in addressing feature selection challenges and optimizing dimensionality in various applications. The method is available in the Python library DADApy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。