统一处理缺失数据与变量选择,提升聚类准确性
A Unified Framework for Variable Selection in Model-Based Clustering with Missing Not at Random
- 引入数据驱动的惩罚矩阵实现灵活变量筛选
- 显式建模缺失机制与潜在类别关系,保持一致性
- 适用于转录组等复杂缺失数据场景,适合生物信息研究者
基于模型的聚类结合变量选择是揭示复杂数据中潜在结构的强大工具。然而,其效果常受限于两个挑战:识别定义异质子群的相关变量,以及处理缺失不随机(Missing Not at Random)的数据,这在转录组学等领域极为常见。现有方法多孤立解决这些问题,灵活性不足。本文提出一种统一框架,通过在惩罚聚类中引入数据驱动的惩罚矩阵,实现更灵活的变量选择,并显式建模缺失性与潜在类别成员之间的关系。证明在一定正则条件下,该框架即使在缺失数据存在时仍具备渐近一致性和选择一致性。通过模拟及合成与真实转录组数据验证,该方法显著提升了模型的识别能力与计算效率。
原文摘要 · Abstract (English)
Model-based clustering integrated with variable selection is a powerful tool for uncovering latent structures within complex data. However, its effectiveness is often hindered by challenges such as identifying relevant variables that define heterogeneous subgroups and handling data that are missing not at random, a prevalent issue in fields like transcriptomics. While several notable methods have been proposed to address these problems, they typically tackle each issue in isolation, thereby limiting their flexibility and adaptability. This paper introduces a unified framework designed to address these challenges simultaneously. Our approach incorporates a data-driven penalty matrix into penalized clustering to enable more flexible variable selection, along with a mechanism that explicitly models the relationship between missingness and latent class membership. We demonstrate that, under certain regularity conditions, the proposed framework achieves both asymptotic consistency and selection consistency, even in the presence of missing data. This unified strategy significantly enhances the capability and efficiency of model-based clustering, advancing methodologies for identifying informative variables that define homogeneous subgroups in the presence of complex missing data patterns. The performance of the framework, including its computational efficiency, is evaluated through simulations and demonstrated using both synthetic and real-world transcriptomic datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。