arXiv:2511.03000stat.MLcs.IT2025-11被引 1

统一了聚类相似性度量的两大方法体系,揭示其内在联系。

Unifying Information-Theoretic and Pair-Counting Clustering Similarity

  • 从共现加权展开角度,将两类度量统一为不同阶数的近似形式。
  • 证明信息论方法是成对关系的高阶扩展,可捕捉更复杂的聚类结构。
  • 为选择和解释聚类评估指标提供理论依据,适合研究者参考。

聚类相似性度量在评估无监督模型中至关重要,但现有方法常产生差异甚至矛盾的结果。当前度量主要分为两类:基于元素对的配对计数法与基于信息论的统计方法,分别通过局部配对或全局联合分布来衡量一致性。以往工作虽发现二者存在关联,并引入经验归一化或期望校正,但其深层联系仍不清晰。本文建立一个分析框架,从两个互补视角实现统一:第一,两类度量均可表示为观测与期望共现的加权展开,其中配对计数法是二次低阶近似,而信息论方法是更高阶、频率加权的扩展;第二,将配对计数推广至k元组一致,表明信息论度量系统性地累积了超过成对水平的分配结构。以兰德指数与互信息为例进行解析,说明各类指标如何自然衍生。该框架阐明了两类方法分歧的条件,直接关联敏感性与加权方式及近似阶数,为跨应用选择、解释与拓展聚类相似性度量提供了严谨基础。

原文摘要 · Abstract (English)

Comparing clusterings is central to evaluating unsupervised models, yet the many existing similarity measures can produce widely divergent, sometimes contradictory, evaluations. Clustering similarity measures are typically organized into two principal families, pair-counting and information-theoretic, reflecting whether they quantify agreement through element pairs or aggregate information across full cluster contingency tables. Prior work has uncovered parallels between these families and applied empirical normalization or chance-correction schemes, but their deeper analytical connection remains only partially understood. Here, we develop an analytical framework that unifies these families through two complementary perspectives. First, both families are expressed as weighted expansions of observed versus expected co-occurrences, with pair-counting arising as a quadratic, low-order approximation and information-theoretic measures as higher-order, frequency-weighted extensions. Second, we generalize pair-counting to k-tuple agreement and show that information-theoretic measures can be viewed as systematically accumulating higher-order co-assignment structure beyond the pairwise level. We illustrate the approaches analytically for the Rand index and Mutual Information, and show how other indices in each family emerge as natural extensions. Together, these views clarify when and why the two regimes diverge, relating their sensitivities directly to weighting and approximation order, and provide a principled basis for selecting, interpreting, and extending clustering similarity measures across applications.

聚类评估信息论相似性度量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。