arXiv:2504.12270cs.LGstat.AP2025-04

用多种评估指标比较三种聚类方法,发现认知数据中潜在的痴呆风险分组。

Comparative analysis of unsupervised clustering techniques using validation metrics: Study on cognitive features from the Canadian Longitudinal Study on Aging (CLSA)

  • 采用熵和分离指数等内部指标评估聚类效果,筛选最优算法。
  • K-means与PAM结果相似,但与层次聚类差异显著。
  • 适用于医疗数据分析,尤其适合研究老年认知变化与痴呆关联。

本研究旨在利用加拿大纵向老龄化研究(CLSA)数据,基于认知特征探索不同聚类算法在无监督学习中的应用,并通过多种评估指标分析其性能。研究纳入18,891名参与者,其基线与随访数据均可用。采用K均值(KM)、层次聚类(HC)和围绕中心点划分(PAM)三种聚类方法。使用平均轮廓系数、WB比率、熵、Calinski-Harabasz指数、分离指数等内部指标,以及同质性、完整性、调整兰德指数(ARI)、兰德指数(RI)和信息变异等对比指标进行评估。结果显示,K-means与PAM表现相近,而与层次聚类存在显著差异。研究强调熵与分离指数的重要性,同时发现调整兰德指数是关键的外部评估工具。结果有助于理解痴呆发展过程中的潜在分组模式,为未来医疗研究提供方法参考。

原文摘要 · Abstract (English)

Purpose: The primary goal of this study is to explore the application of evaluation metrics to different clustering algorithms using the data provided from the Canadian Longitudinal Study (CLSA), focusing on cognitive features. The objective of our work is to discover potential clinically relevant clusters that contribute to the development of dementia over time-based on cognitive changes. Method: The CLSA dataset includes 18,891 participants with data available at both baseline and follow-up assessments, to which clustering algorithms were applied. The clustering methodologies employed in this analysis are K-means (KM) clustering, Hierarchical Clustering (HC) and Partitioning Around Medoids (PAM). We use multiple evaluation metrics to assess our analysis. For internal evaluation metrics, we use: Average silhouette Width, Within and Between the sum of square Ratio (WB.Ratio), Entropy, Calinski-Harabasz Index (CH Index), and Separation Index. For clustering comparison metrics, we used: Homogeneity, Completeness, Adjusted Rand Index (ARI), Rand Index (RI), and Variation Information. Results: Using evaluation metrics to compare the results of the three clustering techniques, K-means and Partitioning Around Medoids (PAM) produced similar results. In contrast, there are significant differences between K-means clustering and Hierarchical Clustering. Our study highlights the importance of the two internal evaluation metrics: entropy and separation index. In between clustering comparison metrics, the Adjusted Rand Index is a key tool. Conclusion: The study results have the potential to contribute to understanding dementia. Researchers can also benefit by applying the suggested evaluation metrics to other areas of healthcare research. Overall, our study improves the understanding of using clustering techniques and evaluation metrics to reveal complex patterns in medical data.

聚类分析认知研究痴呆预测医学数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。