动态数据下保持聚类精度,实现高效更新的层次聚类方法
Dynamic data summarization for hierarchical spatial clustering
- 用Bubble-tree树结构在线摘要动态数据,减少重复计算
- 支持点增删时精确更新聚类层级,无需从头重构
- 适合实时流数据、频繁变化的空间数据场景
层次密度聚类算法HDBSCAN通过密度和空间邻近性发现空间数据中的有意义模式。由于该算法本质上为静态场景设计,现有研究主要聚焦于通过近似或并行方法加速静态场景下的运算。然而,针对动态环境的研究较少:即使单个点的插入或删除,也需因维护完整图上的最小生成树(MST)而重新计算整个聚类层级。本文提出一种精确算法,在点插入与删除时维护密度信息并更新HDBSCAN的聚类层级。考虑到精确算法在现代动态负载下的适应难度,我们设计了一种在线-离线框架:在线部分使用名为Bubble-tree的树结构高效总结动态数据,离线部分执行静态聚类。实验表明,该数据摘要在完全动态环境中表现良好,压缩质量与现有技术相当,同时显著提升动态数据工作负载下的聚类算法运行效率。
原文摘要 · Abstract (English)
Hierarchical Density-Based Spatial Clustering of Applications with Noise (HDBSCAN) finds meaningful patterns in spatial data by considering density and spatial proximity. As the clustering algorithm is inherently designed for static applications, so have recent studies focused on accelerating the algorithm for static applications using approximate or parallel methods. However, much less attention has been given to dynamic environments, where even a single point insertion or deletion can require recomputing the clustering hierarchy from scratch due to the need of maintaining the minimum spanning tree (MST) over a complete graph. This paper addresses the challenge of enhancing the clustering algorithm for dynamic data. We present an exact algorithm that maintains density information and updates the clustering hierarchy of HDBSCAN during point insertions and deletions. Considering the hardness of adapting the exact algorithm to dynamic data involving modern workloads, we propose an online-offline framework. The online component efficiently summarizes dynamic data using a tree structure, called Bubble-tree, while the offline step performs the static clustering. Experimental results demonstrate that the data summarization adapts well to fully dynamic environments, providing compression quality on par with existing techniques while significantly improving runtime performance of the clustering algorithm in dynamic data workloads.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。