arXiv:2502.15759cs.LG2025-02被引 11

提出双模型核机框架,提升复杂数据的分类回归性能。

TRKM: Twin Restricted Kernel Machines for Classification and Regression

  • 结合孪生模型与受限核机,利用对偶变量优化问题
  • 在UCI、KEEL及脑龄数据集上超越基线模型表现
  • 适合处理分布不均或高维复杂数据的场景

受限核机(RKMs)显著提升了机器学习中的泛化能力。近期研究将核函数与最小二乘支持向量机(LSSVM)结合,模拟受限玻尔兹曼机(RBM)的能量函数,取得更好性能。然而,面对分布不均或复杂聚类的数据时,RKMs可能泛化能力下降;且随着数据规模增长,高维特征空间的计算负担加剧,影响大规模数据表现。为此,本文提出双受限核机(TRKM),融合孪生模型优势与RKMs稳健性,提升分类与回归任务表现。通过Fenchel-Young不等式引入新的共轭特征对偶,将分类与回归问题转化为对偶变量形式,提供目标函数上界,形成新方法框架。模型采用类似RBM的能量函数,包含对应两类的可见与隐藏变量,并使用核技巧映射至高维特征空间,以正则化最小二乘法寻找最优分割超平面。在UCI与KEEL数据集上的实验验证了TRKM优于基线模型,展现出强鲁棒性与高效性。此外,在脑龄预测数据集上的实现进一步证明其有效性。

原文摘要 · Abstract (English)

Restricted kernel machines (RKMs) have considerably improved generalization in machine learning. Recent advancements explored various techniques within the RKM framework, integrating kernel functions with least squares support vector machines (LSSVM) to mirror the energy function of restricted Boltzmann machines (RBM), leading to enhanced performance. However, RKMs may face challenges in generalization when dealing with unevenly distributed or complexly clustered data. Additionally, as the dataset size increases, the computational burden of managing high-dimensional feature spaces can become substantial, potentially hindering performance in large-scale datasets. To address these challenges, we propose twin restricted kernel machine (TRKM). TRKM combines the benefits of twin models with the robustness of the RKM framework to enhance classification and regression tasks. By leveraging the Fenchel-Young inequality, we introduce a novel conjugate feature duality, allowing the formulation of classification and regression problems in terms of dual variables. This duality provides an upper bound to the objective function of the TRKM problem, resulting in a new methodology under the RKM framework. The model uses an energy function similar to that of RBM, incorporating both visible and hidden variables corresponding to both classes. Additionally, the kernel trick is employed to map data into a high-dimensional feature space, where the model identifies an optimal separating hyperplane using a regularized least squares approach. Experiments on UCI and KEEL datasets confirm TRKM's superiority over baselines, showcasing its robustness and efficiency in handling complex data. Furthermore, We implemented the TRKM model on the brain age dataset, demonstrating its efficacy in predicting brain age.

核方法分类回归双模型脑龄预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。