针对高维噪声数据的聚类难题,提出可自适应增长结构的变分聚类框架。
A Data-Informed Variational Clustering Framework for Noisy High-Dimensional Data
- 通过全局特征门控与分段自适应结构增长实现稳定聚类
- 在严重特征噪声下仍保持良好性能且计算可行
- 适合处理高维噪声数据且结果可解释,适合实际应用
在高维数据中存在严重特征噪声的情况下进行聚类仍然具有挑战性,尤其当仅有少数维度具有信息量且簇数量事先未知时。此时,划分恢复、特征相关性学习与结构自适应紧密耦合,传统基于似然的方法可能变得不稳定或对噪声维度过于敏感。我们提出DIVI,一种数据驱动的变分聚类框架,结合全局特征门控与基于分段的自适应结构增长。DIVI使用信息性先验初始化以稳定优化过程,以可微方式学习特征相关性,并仅在局部诊断表明欠拟合时扩展模型复杂度。除了聚类性能外,我们还考察了运行时间可扩展性与参数敏感性,以明确该框架的计算与实际行为。实验表明,即使在严重特征噪声下,DIVI仍表现良好,计算上可行,且产生可解释的特征门控行为,同时表现出保守的结构增长和可识别的失败模式。总体而言,DIVI更适合作为面向噪声高维数据的实用变分聚类框架,而非完全贝叶斯生成解。
原文摘要 · Abstract (English)
Clustering in high-dimensional settings with severe feature noise remains challenging, especially when only a small subset of dimensions is informative and the final number of clusters is not specified in advance. In such regimes, partition recovery, feature relevance learning, and structural adaptation are tightly coupled, and standard likelihood-based methods can become unstable or overly sensitive to noisy dimensions. We propose DIVI, a data-informed variational clustering framework that combines global feature gating with split-based adaptive structure growth. DIVI uses informative prior initialization to stabilize optimization, learns feature relevance in a differentiable manner, and expands model complexity only when local diagnostics indicate underfit. Beyond clustering performance, we also examine runtime scalability and parameter sensitivity in order to clarify the computational and practical behavior of the framework. Empirically, we find that DIVI performs competitively under severe feature noise, remains computationally feasible, and yields interpretable feature-gating behavior, while also exhibiting conservative growth and identifiable failure regimes in challenging settings. Overall, DIVI is best viewed as a practical variational clustering framework for noisy high-dimensional data rather than as a fully Bayesian generative solution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。