提出新型随机核机模型,提升高光谱图像分类精度与稳定性
Randomized based restricted kernel machine for hyperspectral image classification
- 构建分层核机制,融合可见与隐藏变量捕捉复杂非线性关系
- 引入对偶变量上界约束,使模型在多个数据集上准确率超基线10%以上
- 适合处理高维复杂数据,尤其适用于遥感图像与真实世界数据
近年来,随机向量函数链接(RVFL)网络因结构简单、计算快速且泛化能力强,在高光谱图像(HSI)分类中备受关注。然而,其输入到隐层权重的随机初始化易导致性能不稳定,且难以确定最优隐层节点数,影响在复杂数据上的表现。为此,本文提出一种新型随机化受限核机($R^2KM$)模型,结合了RVFL与受限核机(RKM)的优势。$R^2KM$采用类似受限玻尔兹曼机能量函数的分层结构,通过可见与隐藏变量表示核方法,更有效地建模复杂数据交互与非线性关系,增强可解释性与鲁棒性。核心贡献在于基于Fenchel-Young不等式的共轭特征对偶性,将问题转化为共轭对偶变量形式,提供目标函数的上界,显著提升模型灵活性与可扩展性。在多个高光谱图像数据集及来自UCI和KEEL的真实数据集上进行的大量实验表明,$R^2KM$在分类与回归任务中均优于基线模型,验证了其有效性。
原文摘要 · Abstract (English)
In recent years, the random vector functional link (RVFL) network has gained significant popularity in hyperspectral image (HSI) classification due to its simplicity, speed, and strong generalization performance. However, despite these advantages, RVFL models face several limitations, particularly in handling non-linear relationships and complex data structures. The random initialization of input-to-hidden weights can lead to instability, and the model struggles with determining the optimal number of hidden nodes, affecting its performance on more challenging datasets. To address these issues, we propose a novel randomized based restricted kernel machine ($R^2KM$) model that combines the strehyperngths of RVFL and restricted kernel machines (RKM). $R^2KM$ introduces a layered structure that represents kernel methods using both visible and hidden variables, analogous to the energy function in restricted Boltzmann machines (RBM). This structure enables $R^2KM$ to capture complex data interactions and non-linear relationships more effectively, improving both interpretability and model robustness. A key contribution of $R^2KM$ is the introduction of a novel conjugate feature duality based on the Fenchel-Young inequality, which expresses the problem in terms of conjugate dual variables and provides an upper bound on the objective function. This duality enhances the model's flexibility and scalability, offering a more efficient and flexible solution for complex data analysis tasks. Extensive experiments on hyperspectral image datasets and real-world data from the UCI and KEEL repositories show that $R^2KM$ outperforms baseline models, demonstrating its effectiveness in classification and regression tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。