用无监督学习自动识别射电异常信号,大幅减少误报。
Anomaly Detection and Radio-frequency Interference Classification with Unsupervised Learning in Narrowband Radio Technosignature Searches
- 用HDBSCAN聚类算法对射电信号分组,识别异常和干扰
- 在97个星系搜索中误报事件减少99.3%,误报率降低93.1%
- 适合大规模射电巡天项目,减轻人工核查负担
射电技术信号搜寻本质上是异常检测问题:候选信号如同茫茫数据中的一根针,而射频干扰(RFI)则构成庞大的背景噪音。当前搜索框架在大规模巡天中产生大量假阳性信号,需耗费大量人力进行后续排查。本文提出GLOBULAR(基于降维后无监督学习的低频观测聚类)方法,利用HDBSCAN算法对信号进行聚类,有效筛选出最异常的信号,并将具有相似形态的RFI信号归为一类。结合标准窄带信号检测与空间滤波流程(如turboSETI),GLOBULAR显著降低了假阳性率。在97个邻近星系的L波段搜索中,相比Choza等人仅使用turboSETI的方法,本方法实现假阳性命中率下降93.1%、假阳性事件减少99.3%。通过清除高谱密度区域的干扰信号,GLOBULAR还有助于发现原标准流程遗漏的潜在信号。
原文摘要 · Abstract (English)
The search for radio technosignatures is an anomaly detection problem: Candidate signals represent needles of interest in the proverbial haystack of radio-frequency interference (RFI). Current search frameworks find an enormity of false-positive signals, especially in large surveys, requiring manual follow-up to a sometimes prohibitive degree. Unsupervised learning provides an algorithmic way to winnow the most anomalous signals from the chaff, as well as group together RFI signals that bear morphological similarities. We present GLOBULAR (Grouping Low-frequency Observations By Unsupervised Learning After Reduction) clustering, a signal processing method that uses HDBSCAN to reduce the false-positive rate and isolate outlier signals for further analysis. When combined with a standard narrowband signal detection and spatial filtering pipeline, such as turboSETI, GLOBULAR clustering offers significant improvements in the false-positive rate over the standard pipeline alone, suggesting dramatic potential for the amelioration of manual follow-up requirements for future large surveys. By removing RFI signals in regions of high spectral occupancy, GLOBULAR clustering may also enable the detection of signals missed by the standard pipeline. We benchmark our method against the Choza et al. turboSETI-only search of 97 nearby galaxies at the L band, demonstrating a false-positive hit reduction rate of 93.1% and a false-positive event reduction rate of 99.3%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。