用自适应邻域大小提升非线性降维效果,无需人工调参。
A general framework for adaptive nonparametric dimensionality reduction
- 基于内在维度估计自动确定最优邻域范围
- 在真实与模拟数据上显著提升经典降维方法性能
- 适合需要高质量可视化和参数自动调节的研究者
降维是现代数据科学中的基础任务。一些针对数据非线性特征设计的投影方法依赖局部嵌入,通常需调整邻居数量及低维空间维度,这些超参数对嵌入质量影响重大。本文利用一种新提出的内在维度估计器,该方法同时输出符合特定标准的最优局部自适应邻域大小。原则上,该自适应框架可为所有依赖局部邻域结构的降维算法实现最优超参数调优。在真实世界与模拟数据集上的数值实验表明,将该方法应用于多种学习任务时,能显著改进知名投影方法的表现,提升可通过定量指标和低维可视化质量衡量。
原文摘要 · Abstract (English)
Dimensionality reduction is a fundamental task in modern data science. Several projection methods specifically tailored to take into account the non-linearity of the data via local embeddings have been proposed. Such methods are often based on local neighbourhood structures and require tuning the number of neighbours that define this local structure, and the dimensionality of the lower-dimensional space onto which the data are projected. Such choices critically influence the quality of the resulting embedding. In this paper, we exploit a recently proposed intrinsic dimension estimator which also returns the optimal locally adaptive neighbourhood sizes according to some desirable criteria. In principle, this adaptive framework can be employed to perform an optimal hyper-parameter tuning of any dimensionality reduction algorithm that relies on local neighbourhood structures. Numerical experiments on both real-world and simulated datasets show that the proposed method can be used to significantly improve well-known projection methods when employed for various learning tasks, with improvements measurable through both quantitative metrics and the quality of low-dimensional visualizations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。