arXiv:2604.22633stat.MLcs.LG2026-04

提出可处理多重归属的高斯混合模型,提升对复杂重叠结构的建模能力。

Mixed Membership sub-Gaussian Models

论文配图:Mixed Membership sub-Gaussian Models
图 1 · 摘自论文原文
  • 允许每个样本属于多个成分,突破传统模型单归属限制
  • 在中心点适度分离条件下,个体隶属向量估计误差可任意小
  • 首个具有零误差保证的高效算法,适合基因、社交网络等场景

高斯混合模型因简洁和可解释性被广泛用于无监督学习。但经典模型要求每个观测值仅属于一个成分,这在基因组学、社交网络分析和文本挖掘等实际应用中受限,因为观测值常同时参与多个潜在成分。为此,本文提出混合隶属子高斯模型,扩展经典高斯混合框架,允许每个观测值同时隶属于多个成分。该模型保持了原模型的可解释性,同时具备更强的灵活性以捕捉复杂的重叠结构。我们设计了一种高效的谱算法来估计每个个体的混合隶属关系,并在成分中心满足温和分离条件时,证明了个体隶属向量的估计误差可高概率地任意小。据我们所知,这是首个为高斯混合模型的混合隶属扩展提供计算高效且误差趋于零的估计器的工作。大量实验表明,本方法显著优于忽略混合隶属的现有方法。

原文摘要 · Abstract (English)

The Gaussian mixture model is widely used in unsupervised learning, owing to its simplicity and interpretability. However, a fundamental limitation of the classical Gaussian mixture model is that it forces each observation to belong to exactly one component. In many practical applications, such as genetics, social network analysis, and text mining, an observation may naturally belong to multiple components or exhibit partial membership in several latent components. To overcome this limitation, we propose the mixed membership sub-Gaussian model, which extends the classical Gaussian mixture framework by allowing each observation to belong to multiple components. This model inherits the interpretability of the classical Gaussian mixture model while offering greater flexibility for capturing complex overlapping structures. We develop an efficient spectral algorithm to estimate the mixed membership of each individual observation, and under mild separation conditions on the component centres, we prove that the estimation error of the per-individual membership vector can be made arbitrarily small with high probability. To our knowledge, this is the first work to provide a computationally efficient estimator with such a vanishing-error guarantee for a mixed-membership extension of the Gaussian mixture model. Extensive experimental studies demonstrate that our method outperforms existing approaches that ignore mixed memberships.

混合隶属高斯混合谱算法无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。