arXiv:2410.14326cs.ITcs.CV2024-10被引 3

提出两种快速近似杰弗里斯中心的新方法,提升计算效率。

Fast proxy centers for Jeffreys centroids: The Jeffreys-Fisher-Rao and the inductive Gauss-Bregman centers

  • 用Fisher-Rao中点构造新中心,支持分类与正态分布的闭式解。
  • 实验显示新中心与杰弗里斯中心接近,且收敛性良好。
  • 适合需要高效计算的图像、语音聚类任务,尤其在信息几何场景下。

对称KL散度中心(即杰弗里斯中心)在信息检索、信息融合及图像、视频和音频处理的聚类任务中具有重要作用。然而,对于分类分布或正态分布这类常用统计模型,杰弗里斯中心无法解析表达,需数值逼近。本文首先提出新的杰弗里斯-费舍尔-罗中心,定义为单向KL中心的费舍尔-罗中点,作为杰弗里斯中心的可替换方案。该中心对单参数指数族分布有通用公式,对分类与正态分布存在闭式解,且在均值相同情况下与杰弗里斯中心完全一致,实验表明其与真实杰弗里斯中心高度接近。其次,提出一种广义的归纳中心,基于指数族密度对的高斯算术-几何双序列均值原理,实验表明该中心能很好地逼近杰弗里斯中心,当杰弗里斯-费舍尔-罗中心无闭式解时可替代使用。此外,该高斯-布雷格曼归纳中心始终收敛,并在均值相同的正态分布集合上精确匹配杰弗里斯中心。实验验证了这两种快速代理中心的有效性。最后,从信息几何的双重平坦空间视角重新解读这些快速代理中心。

原文摘要 · Abstract (English)

The symmetric Kullback-Leibler centroid also called the Jeffreys centroid of a set of mutually absolutely continuous probability distributions on a measure space provides a notion of centrality which has proven useful in many tasks including information retrieval, information fusion, and clustering in image, video and sound processing. However, the Jeffreys centroid is not available in closed-form for sets of categorical or normal distributions, two widely used statistical models, and thus need to be approximated numerically in practice. In this paper, we first propose the new Jeffreys-Fisher-Rao center defined as the Fisher-Rao midpoint of the sided Kullback-Leibler centroids as a plug-in replacement of the Jeffreys centroid. This Jeffreys-Fisher-Rao center admits a generic formula for uni-parameter exponential family distributions, and closed-form formula for categorical and normal distributions, matches exactly the Jeffreys centroid for same-mean normal distributions, and is experimentally observed in practice to be close to the Jeffreys centroid. Second, we define a new type of inductive centers generalizing the principle of Gauss arithmetic-geometric double sequence mean for pairs of densities of any given exponential family. This center is shown experimentally to approximate very well the Jeffreys centroid and is suggested to use when the Jeffreys-Fisher-Rao center is not available in closed form. Moreover, this Gauss-Bregman inductive center always converges and matches the Jeffreys centroid for sets of same-mean normal distributions. We report on our experiments demonstrating the use of the Jeffreys-Fisher-Rao and Gauss-Bregman centers instead of the Jeffreys centroid. Finally, we conclude this work by reinterpreting these fast proxy centers of Jeffreys centroids under the lens of dually flat spaces in information geometry.

信息几何聚类中心概率分布快速算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。