arXiv:2607.14880math.STcs.LG2026-07

用图结构扩散距离量化空间聚类,比传统方法更敏感且具理论保证。

Measuring Spatial Clustering via Metropolis-Hastings Diffusion Distance

论文配图:Measuring Spatial Clustering via Metropolis-Hastings Diffusion Distance
图 1 · 摘自论文原文
  • 基于马尔可夫链收敛速率定义新距离度量,融合全局图结构信息。
  • 在合成数据上显著提升检测聚类的统计功效,实证发现城市种族隔离差异。
  • 理论严谨,支持大规模数据高效检验,适合社会学、地理分析等场景。

我们提出一种新的概率分布差异度量——扩散距离,用于衡量图上两个分布 $f$ 与 $g$ 之间的差距,该度量基于以 $g$ 为平稳分布的图约束马尔可夫链下 $f$ 的收敛速度。默认采用目标分布为 $g$、提议由图上的随机游走给出的梅特罗波利斯-哈斯廷斯转移矩阵。当 $g$ 为均匀分布时,扩散距离成为衡量 $f$ 空间聚类程度的指标。此时,该方法扩展了传统的莫兰 $I$ 型空间自相关度量,引入全局图几何而非仅局部模式。事实上,莫兰 $I$ 可视为扩散距离的一种一步启发式近似,前提是使用特定空间权重。我们建立了该度量的理论界和稳定性结果,揭示其与图谱和最优传输的联系。随后,我们设计了一种基于置换零模型的统计检验,利用精确的谱公式推导出高概率的扩散距离界限,实现了大规模数据下的高效聚类检验。实验对比显示,扩散距离在随机块模型生成的合成数据中具有更高检验功效;对美国100个城市的黑人人口分布进行实证分析,发现其能捕捉莫兰 $I$ 无法察觉的细微城市分异模式。

原文摘要 · Abstract (English)

We propose a novel measure of the discrepancy between two probability distributions $f$ and $g$ on a graph - which we call the diffusion distance - that measures the rate of convergence of $f$ to $g$ under a graph-constrained Markov chain with stationary distribution $g$. As a default choice for this Markov chain, we use the Metropolis-Hastings transition matrix targeting $g$ with proposals given by a random walk on the graph. Our primary case of interest is when the second distribution $g$ is uniform, in which case the diffusion distance becomes a measure of spatial clustering in $f$. Used in this way, (Metropolis-Hastings) diffusion distance to uniformity extends Moran's $I$-type measures of spatial autocorrelation by incorporating global graph geometry rather than just local patterns. Indeed, Moran's $I$, the most well-known measure of spatial autocorrelation, can be viewed as a one-step heuristic for diffusion distance, so long as specific spatial weights are used. We establish theoretical bounds and a stability result for our measure, connecting it to graph spectra and optimal transport. We then turn our attention to outlining a statistical test for spatial clustering using diffusion distance. Under permutation null models, we derive high-probability bounds on diffusion distance underpinned by exact spectral formulas for convergence of distributions, enabling an efficient statistical test for spatial clustering on large datasets. We empirically compare diffusion distance to Moran's $I$ both as a numerical measure and as a statistical test. We show that diffusion distance exhibits higher power on synthetic data using a stochastic block model. Empirical analysis of Black population distributions for 100 U.S. cities shows that diffusion distance detects subtle differences in urban segregation patterns that Moran's $I$ does not.

空间分析图神经网络统计检验聚类检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。