新模型通过正则化最小二乘法提升多视图分类效率与精度。
Twin Restricted Kernel Machines for Multiview Classification
- 用正则化最小二乘替代传统二次规划,加速求解过程。
- 在UCI、KEEL和AwA数据集上均优于基线模型,泛化能力更强。
- 融合早融合与晚融合策略,适应各视图差异,适合多源数据分类任务。
多视图学习(MVL)旨在通过多个视角的互补信息提升模型泛化性能。尽管多视图支持向量机(MvSVM)已取得显著进展,但其在高维空间中利用核技巧捕捉决策边界时面临计算复杂与误判问题,且对视图不一致敏感。本文提出多视图孪生受限核机(TMvRKM),将核方法与多视图框架结合,解决传统核方法的计算与泛化挑战。不同于依赖大规模二次规划的问题求解,该模型采用正则化最小二乘法高效确定最优分隔超平面,提升计算效率与分类性能。其原始目标函数包含耦合项,有效平衡多视图间误差。通过集成早期与晚期融合策略,训练中充分利用所有视图信息,同时保留单个视图的灵活性。在UCI、KEEL和AwA基准数据集上的实验结果与统计分析表明,该模型在所有场景下均显著优于基线模型,展现卓越的泛化能力。
原文摘要 · Abstract (English)
Multi-view learning (MVL) is an emerging field in machine learning that focuses on improving generalization performance by leveraging complementary information from multiple perspectives or views. Various multi-view support vector machine (MvSVM) approaches have been developed, demonstrating significant success. Moreover, these models face challenges in effectively capturing decision boundaries in high-dimensional spaces using the kernel trick. They are also prone to errors and struggle with view inconsistencies, which are common in multi-view datasets. In this work, we introduce the multiview twin restricted kernel machine (TMvRKM), a novel model that integrates the strengths of kernel machines with the multiview framework, addressing key computational and generalization challenges associated with traditional kernel-based approaches. Unlike traditional methods that rely on solving large quadratic programming problems (QPPs), the proposed TMvRKM efficiently determines an optimal separating hyperplane through a regularized least squares approach, enhancing both computational efficiency and classification performance. The primal objective of TMvRKM includes a coupling term designed to balance errors across multiple views effectively. By integrating early and late fusion strategies, TMvRKM leverages the collective information from all views during training while remaining flexible to variations specific to individual views. The proposed TMvRKM model is rigorously tested on UCI, KEEL, and AwA benchmark datasets. Both experimental results and statistical analyses consistently highlight its exceptional generalization performance, outperforming baseline models in every scenario.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。