arXiv:2512.19373stat.MLcs.LG2025-12

用随机傅里叶特征建模数据异质性,实现高精度可解释回归。

Cluster-Based Generalized Additive Models Informed by Random Fourier Features

  • 通过随机傅里叶特征学习谱表示,捕捉数据预测变化。
  • 在各聚类区间内用样条函数建模非线性关系,提升预测性能。
  • 适合需要透明性与灵活性兼顾的机器学习应用。

为解决黑箱模型预测力强但缺乏透明度的问题,本文提出一种结合响应感知谱表示学习与局部可加建模的可解释回归框架。首先通过随机傅里叶特征回归建模,并基于学习到的振幅和自适应重采样频率构建谱特征映射,以反映数据中的预测差异。该表示经主成分分析压缩为低维潜在嵌入,再通过高斯混合模型进行软区域发现。每个区域内部采用特定于聚类的广义可加模型,利用可解释的样条基函数捕捉非线性协变量效应。最终预测器由这些局部可加模型的软混合构成,灵活建模非线性异质结构的同时保持可解释性。在多个基准回归数据集上的实验表明,该方法在保持可解释性的同时,优于经典全局可解释基线,且与更灵活的黑箱模型表现相当。整体框架提供了一种统一的异质回归解决方案,兼具预测适应性与局部可解释性。

原文摘要 · Abstract (English)

In developing data-driven modeling methodologies, there is an ongoing need to reconcile the strong predictive performance of opaque black-box models with the transparency required for critical applications. This work introduces an interpretable and computationally tractable regression framework for heterogeneous data by combining response-informed spectral representation learning with localized additive modeling. The method first fits a random Fourier feature regression model and constructs a spectral feature map from the learned amplitudes and adaptively resampled frequencies, so that the representation reflects predictive variation in the data. This representation is then compressed by principal component analysis to obtain a low-dimensional latent embedding, in which a Gaussian mixture model performs soft regime discovery. Within each regime, a cluster-specific generalized additive model captures nonlinear covariate effects through interpretable spline-based univariate smooth functions. The final predictor is formed as a soft mixture of these local additive models, enabling flexible modeling of a nonlinear, heterogeneous structure while preserving interpretability. Numerical experiments across several benchmark regression datasets show that the proposed method consistently improves upon classical globally interpretable baselines while remaining competitive with more flexible black-box models. Overall, the framework provides a unified approach to heterogeneous regression that combines predictive adaptivity with interpretable local covariate effects.

可解释建模广义可加模型聚类分析随机傅里叶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。