arXiv:2507.11136stat.MLcs.LG2025-07被引 4

自动确定模型复杂度并解释特征重要性,提升可解释性与预测精度。

Interpretable Bayesian Tensor Network Kernel Machines with Automatic Rank and Feature Selection

  • 用层次先验自动推断张量秩和特征维度,无需手动调参。
  • 在真实数据上表现更优,准确率、可解释性与可扩展性均领先。
  • 融合贝叶斯框架,实现不确定性量化且不增加计算开销。

张量网络(TN)核机器通过将参数表示为低秩张量网络,降低计算与内存消耗,加速模型学习。然而,多数基于张量网络的核方法为确定性模型,忽略参数不确定性,且需手动调节张量秩、特征维度等超参数,常依赖试错或代价高昂的交叉验证。本文提出贝叶斯张量网络核机器,采用稀疏诱导的层次先验对张量因子建模,实现模型复杂度的自动推断。该框架可自动确定张量秩与特征维度,并识别对预测最相关的特征,增强模型可解释性。所有参数与超参数均作为具有对应先验的隐变量处理。针对贝叶斯框架与隐变量依赖关系,采用均值场变分推断近似后验分布。结果表明,对张量因子施加均值场近似可得到与确定性版本相同复杂度的贝叶斯交替最小二乘算法,实现不确定性量化而无额外计算成本。在合成与真实数据集上的实验显示,本模型在预测精度、不确定性量化、可解释性与可扩展性方面均优于现有方法。

原文摘要 · Abstract (English)

Tensor Network (TN) Kernel Machines speed up model learning by representing parameters as low-rank TNs, reducing computation and memory use. However, most TN-based Kernel methods are deterministic and ignore parameter uncertainty. Further, they require manual tuning of model complexity hyperparameters like tensor rank and feature dimensions, often through trial-and-error or computationally costly methods like cross-validation. We propose Bayesian Tensor Network Kernel Machines, a fully probabilistic framework that uses sparsity-inducing hierarchical priors on TN factors to automatically infer model complexity. This enables automatic inference of tensor rank and feature dimensions, while also identifying the most relevant features for prediction, thereby enhancing model interpretability. All the model parameters and hyperparameters are treated as latent variables with corresponding priors. Given the Bayesian approach and latent variable dependencies, we apply a mean-field variational inference to approximate their posteriors. We show that applying a mean-field approximation to TN factors yields a Bayesian ALS algorithm with the same computational complexity as its deterministic counterpart, enabling uncertainty quantification at no extra computational cost. Experiments on synthetic and real-world datasets demonstrate the superior performance of our model in prediction accuracy, uncertainty quantification, interpretability, and scalability.

张量网络贝叶斯方法可解释性自动选择

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。