提出新型数据可视化方法,用引力斥力模拟粒子群,无需调参且可灵活控制聚类紧密度。
Attraction-Repulsion Swarming: A Generalized Framework of t-SNE via Force Normalization and Tunable Interactions
- 将t-SNE视为粒子间引力斥力作用的系统,引入总影响力归一化
- 在MNIST和Cifar-10上实现稳定可视化,可用统一步长(h=1)迭代
- 支持独立调节引力斥力,便于调控聚类紧凑性与间距,适合交互式分析
我们提出一种基于引力-斥力群集(ARS)动力学的新数据可视化方法,称为ARS可视化。该方法将t分布随机邻域嵌入(t-SNE)视为由相互作用粒子组成的群体系统,受到引力与斥力驱动。受群体行为研究启发,我们对t-SNE动态进行改进,引入对总影响力进行归一化,使系统更具稳定性,从而可采用不依赖数据量的固定步长(h=1),并简化迭代过程,无需t-SNE中常用的复杂优化技巧。此外,ARS支持分别调节引力与斥力核函数,让用户能自由控制可视化中聚类内部的紧密程度及聚类间的间隔。与t-SNE不同,本方法并非基于KL散度的梯度下降,而是纯粹作为由引力与斥力驱动的粒子系统。我们提供了理论分析说明交互核的选择如何影响动态演化,并通过实验在MNIST和Cifar-10数据集上验证了方法的有效性,结果表明其性能优于或相当於t-SNE。
原文摘要 · Abstract (English)
We propose a new method for data visualization based on attraction-repulsion swarming (ARS) dynamics, which we call ARS visualization. ARS is a generalized framework that is based on viewing the t-distributed stochastic neighbor embedding (t-SNE) visualization technique as a swarm of interacting agents driven by attraction and repulsion. Motivated by recent developments in swarming, we modify the t-SNE dynamics to include a normalization by the \emph{total influence}, which results in better posed dynamics in which we can use a data size independent time step (of $h=1$) and a simple iteration, without the need for the array of optimization tricks employed in t-SNE. ARS also includes the ability to separately tune the attraction and repulsion kernels, which gives the user control over the tightness within clusters and the spacing between them in the visualization. In contrast with t-SNE, our proposed ARS data visualization method is not gradient descent on the Kullback-Leibler divergence, and can be viewed solely as an interacting particle system driven by attraction and repulsion forces. We provide theoretical results illustrating how the choice of interaction kernel affects the dynamics, and experimental results to validate our method and compare to t-SNE on the MNIST and Cifar-10 data sets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。