用多智能体强化学习自动调参,让DBSCAN在复杂密度数据中更准更稳。
Adaptive and Robust DBSCAN with Multi-agent Reinforcement Learning
- 分层编码树划分密度区域,各区域由专属智能体自适应调参。
- 在真实与人工数据集上,NMI提升144.1%,ARI提升175.3%。
- 适合处理密度差异大的实际数据,无需人工干预参数设置。
DBSCAN是一种著名的基于密度的聚类算法,因其能识别任意形状的簇并处理噪声数据而广受欢迎。然而,在面对不同密度尺度的数据集时,其聚类效果往往不理想,这在现实应用中十分常见。本文提出一种新型自适应鲁棒的DBSCAN框架——AR-DBSCAN,结合多智能体强化学习。首先,将初始数据集建模为双层编码树,根据编码树中的信息不确定性将数据点划分为不同密度分区,并为每个分区分配一个智能体,自主寻找最优聚类参数。该分配机制具有密度自适应性,使AR-DBSCAN能够有效应对数据内部的复杂密度分布。其次,设计了多智能体深度强化学习驱动的自动参数搜索过程,将参数调整方向建模为马尔可夫决策过程,并通过弱监督奖励训练策略网络,使各智能体在与聚类环境交互中自适应学习最优参数。第三,引入可适应数据规模的递归搜索机制,实现对大规模参数空间的高效、可控探索。在九个合成数据集和一个真实世界数据集上进行了大量实验。离线与在线任务结果表明,AR-DBSCAN在NMI和ARI指标上分别提升了最高144.1%和175.3%,且能稳健地发现主导参数。
原文摘要 · Abstract (English)
DBSCAN, a well-known density-based clustering algorithm, has gained widespread popularity and usage due to its effectiveness in identifying clusters of arbitrary shapes and handling noisy data. However, it encounters challenges in producing satisfactory cluster results when confronted with datasets of varying density scales, a common scenario in real-world applications. In this paper, we propose a novel Adaptive and Robust DBSCAN with Multi-agent Reinforcement Learning cluster framework, namely AR-DBSCAN. First, we model the initial dataset as a two-level encoding tree and categorize the data vertices into distinct density partitions according to the information uncertainty determined in the encoding tree. Each partition is then assigned to an agent to find the best clustering parameters without manual assistance. The allocation is density-adaptive, enabling AR-DBSCAN to effectively handle diverse density distributions within the dataset by utilizing distinct agents for different partitions. Second, a multi-agent deep reinforcement learning guided automatic parameter searching process is designed. The process of adjusting the parameter search direction by perceiving the clustering environment is modeled as a Markov decision process. Using a weakly-supervised reward training policy network, each agent adaptively learns the optimal clustering parameters by interacting with the clusters. Third, a recursive search mechanism adaptable to the data's scale is presented, enabling efficient and controlled exploration of large parameter spaces. Extensive experiments are conducted on nine artificial datasets and a real-world dataset. The results of offline and online tasks show that AR-DBSCAN not only improves clustering accuracy by up to 144.1% and 175.3% in the NMI and ARI metrics, respectively, but also is capable of robustly finding dominant parameters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。