用贝叶斯方法同时做去噪和聚类,更可靠地发现数据中的模块结构。
Reliable data clustering with Bayesian community detection
- 基于最小描述长度原则的贝叶斯社区检测,统一处理去噪与聚类
- 在高噪声、小样本下仍能准确识别出预设的簇结构
- 适合基因表达等高维复杂数据的模块分析,结果更稳定
从神经科学、基因组学到生态学,研究者常通过聚类相似性数据来发现模块结构。然而广泛使用的层次聚类、k-means 和 WGCNA 等方法缺乏严谨的模型选择机制,易受噪声影响。常见做法是先对相关矩阵进行稀疏化以去除噪声,但该步骤引入了人为阈值,可能扭曲真实结构,导致结果不可靠。为此,我们利用网络科学最新进展,将稀疏化与聚类结合,并实现严格的模型选择。测试了两种贝叶斯社区检测方法:度校正随机块模型(Degree-Corrected Stochastic Block Model)和正则化地图方程(Regularized Map Equation),二者均基于最小描述长度原则进行模型选择。在合成数据中,两者均优于传统方法,在高噪声条件下和样本量较少时仍能有效检测出预设簇。与 WGCNA 在基因共表达数据上的对比显示,正则化地图方程识别出的基因模块更具稳健性和功能一致性。结果表明,贝叶斯社区检测是一种严谨且抗噪声的框架,适用于跨领域的高维数据模块结构发现。
原文摘要 · Abstract (English)
From neuroscience and genomics to systems biology and ecology, researchers rely on clustering similarity data to uncover modular structure. Yet widely used clustering methods, such as hierarchical clustering, k-means, and WGCNA, lack principled model selection, leaving them susceptible to noise. A common workaround sparsifies a correlation matrix representation to remove noise before clustering, but this extra step introduces arbitrary thresholds that can distort the structure and lead to unreliable results. To detect reliable clusters, we capitalize on recent advances in network science to unite sparsification and clustering with principled model selection. We test two Bayesian community detection methods, the Degree-Corrected Stochastic Block Model and the Regularized Map Equation, both grounded in the Minimum Description Length principle for model selection. In synthetic data, they outperform traditional approaches, detecting planted clusters under high-noise conditions and with fewer samples. Compared to WGCNA on gene co-expression data, the Regularized Map Equation identifies more robust and functionally coherent gene modules. Our results establish Bayesian community detection as a principled and noise-resistant framework for uncovering modular structure in high-dimensional data across fields.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。