用分阶段方法分离已知与未知,发现银河系中隐藏的天体结构。
CLiMB: A Domain-Informed Novelty Detection Clustering Framework for Galactic Archaeology and Scientific Discovery
- 先锚定已知星群,再用密度聚类挖掘未知模式。
- 在盖亚数据中找回90%已知结构,准确率达0.829(调整兰德指数)。
- 适合天文领域发现新天体特征,对小样本也有效。
在数据驱动的科学发现中,如何分类已知现象并识别新颖异常是一大挑战。现有半监督聚类算法常假设监督信号全局一致,导致强制约束抑制意外模式或需预设聚类数,难以实现真实新颖性检测。为此,我们提出CLiMB(分相边界聚类),通过两阶段流程解耦先验知识利用与未知结构探索。第一阶段使用自适应度量约束划分,锚定已知簇;第二阶段对残差数据应用密度聚类,揭示任意拓扑。在盖亚数据发布3中的RR Lyr星数据上验证,CLiMB以90%种子覆盖率恢复已知银河系子结构,调整兰德指数达0.829,显著优于启发式及约束基线(均低于0.20)。敏感性分析显示其数据效率高,性能随知识增加持续提升。最终成功分离出三个独立动力学特征(Shiva、Shakti、银河盘),验证其科学发现潜力。
原文摘要 · Abstract (English)
In data-driven scientific discovery, a challenge lies in classifying well-characterized phenomena while identifying novel anomalies. Current semi-supervised clustering algorithms do not always fully address this duality, often assuming that supervisory signals are globally representative. Consequently, methods often enforce rigid constraints that suppress unanticipated patterns or require a pre-specified number of clusters, rendering them ineffective for genuine novelty detection. To bridge this gap, we introduce CLiMB (CLustering in Multiphase Boundaries), a domain-informed framework decoupling the exploitation of prior knowledge from the exploration of unknown structures. Using a sequential two-phase approach, CLiMB first anchors known clusters using metric-adaptive constrained partitioning, and subsequently applies density-based clustering to residual data to reveal arbitrary topologies. We demonstrate this framework on RR Lyrae stars data from the Gaia Data Release 3. CLiMB attains an Adjusted Rand Index of 0.829 with 90% seed coverage in recovering known Milky Way substructures, outperforming heuristic and constraint-based baselines, which stagnate below 0.20. Furthermore, sensitivity analysis confirms CLiMB's superior data efficiency, showing monotonic improvement as knowledge increases. Finally, the framework successfully isolates three distinct dynamical features (Shiva, Shakti, and the Galactic Disk) in the unlabelled field, validating its potential for scientific discovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。