arXiv:2412.05305cs.NEcs.LG2024-12

用遗传算法优化信息量,让聚类自动适应数据特性。

AdaptiveMDL-GenClust: A Robust Clustering Framework Integrating Normalized Mutual Information and Evolutionary Algorithms

  • 结合最小描述长度与遗传算法,动态优化聚类结果。
  • 在13个数据集上,NMI和ARI均优于传统方法。
  • 适合处理特征多样的复杂数据聚类任务。

聚类算法在数据分析中至关重要,但单一方法常因固有局限和偏差难以适用于所有数据集。为此,我们提出一种融合最小描述长度(MDL)原则与遗传优化算法的鲁棒聚类框架。该框架首先通过集成聚类生成初始解,再利用MDL指导的评估函数进行优化,并通过遗传算法迭代改进。此设计使方法能自适应数据内在特性,降低对初始聚类的依赖,实现数据驱动的稳定聚类。我们在13个基准数据集上,采用准确率、标准化互信息(NMI)、Fisher评分和调整兰德指数(ARI)四项指标进行评估。实验表明,该方法在各项指标上均显著优于传统方法,具备更高准确率、更强稳定性及更低偏差。其良好的适应性使其在多种数据特征场景下表现优异,展现出作为通用可靠聚类工具的潜力。通过整合MDL与遗传优化,本研究在聚类方法学上取得重要进展,有效克服关键缺陷并提升跨场景性能。

原文摘要 · Abstract (English)

Clustering algorithms are pivotal in data analysis, enabling the organization of data into meaningful groups. However, individual clustering methods often exhibit inherent limitations and biases, preventing the development of a universal solution applicable to diverse datasets. To address these challenges, we introduce a robust clustering framework that integrates the Minimum Description Length (MDL) principle with a genetic optimization algorithm. The framework begins with an ensemble clustering approach to generate an initial clustering solution, which is then refined using MDL-guided evaluation functions and optimized through a genetic algorithm. This integration allows the method to adapt to the dataset's intrinsic properties, minimizing dependency on the initial clustering input and ensuring a data-driven, robust clustering process. We evaluated the proposed method on thirteen benchmark datasets using four established validation metrics: accuracy, normalized mutual information (NMI), Fisher score, and adjusted Rand index (ARI). Experimental results demonstrate that our approach consistently outperforms traditional clustering methods, yielding higher accuracy, improved stability, and reduced bias. The methods adaptability makes it effective across datasets with diverse characteristics, highlighting its potential as a versatile and reliable tool for complex clustering tasks. By combining the MDL principle with genetic optimization, this study offers a significant advancement in clustering methodology, addressing key limitations and delivering superior performance in varied applications.

聚类遗传算法MDL数据适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。