用预训练音频模型识别引力波探测中的噪声异常,提升发现新信号的能力。
The Sound of Noise: Leveraging the Inductive Bias of Pre-trained Audio Transformers for Glitch Identification in LIGO
- 将引力波数据视为音频信号,复用预训练音频模型的先验知识。
- 在O3和O4观测数据中,嵌入特征可清晰区分不同噪声类别,准确率优于传统方法。
- 适合需要低标注成本、快速发现新异常信号的研究者使用。
瞬态噪声伪影(即‘噪声突变’)严重限制了引力波干涉仪的灵敏度,并可能模仿真实天体信号,特别是短时程中等质量黑洞合并事件。当前的噪声分类方法如Gravity Spy依赖从头训练的监督模型,需大量专家标注数据,存在显著的“标签瓶颈”,难以泛化到新噪声形态或观测运行中出现的奇异引力波信号。本文提出一种跨域框架,将引力波应变数据以音频处理视角分析,采用在大规模音频数据上预训练的音频谱图变换器(AST),并将其迁移至引力波领域。无需从零学习时频特征,该方法利用预训练模型固有的先验知识,将自然声音表征能力迁移到探测器噪声与引力波信号(包括中等质量黑洞)的表征中。通过t-SNE无监督聚类分析第三(O3)和第四(O4)观测运行的应变数据,结果显示由AST提取的嵌入向量能清晰分离出与独立验证的Gravity Spy噪声类别高度一致的簇。结果表明,音频预训练的先验偏差可实现优于传统监督方法的特征提取能力,为下一代探测器时代提供了一条高效、鲁棒的新异常信号发现与复杂噪声分类路径。
原文摘要 · Abstract (English)
Transient noise artifacts, or glitches, fundamentally limit the sensitivity of gravitational-wave (GW) interferometers and can mimic true astrophysical signals, particularly the short-duration intermediate-mass black hole (IMBH) mergers. Current glitch classification methods, such as Gravity Spy, rely on supervised models trained from scratch using labeled datasets. These approaches suffer from a significant ``label bottleneck," requiring massive, expertly annotated datasets to achieve high accuracy and often struggling to generalize to new glitch morphologies or exotic GW signals encountered in observing runs. In this work, we present a novel cross-domain framework that treats GW strain data through the lens of audio processing. We utilize the Audio Spectrogram Transformer (AST), a model pre-trained on large-scale audio datasets, and adapt it to the GW domain. Instead of learning time-frequency features from scratch, our method exploits the strong inductive bias inherent in pre-trained audio models, transferring learned representations of natural sound to the characterization of detector noise and GW signals, including IMBHs. We validate this approach by analyzing strain data from the third (O3) and fourth (O4) observing runs of the LIGO detectors. We used t-Distributed Stochastic Neighbor Embedding (t-SNE), an unsupervised clustering technique, to visualize the AST-derived embeddings of signals and glitches, revealing well-separated groups that align closely with independently validated Gravity Spy glitch classes. Our results indicate that the inductive bias from audio pre-training allows superior feature extraction compared to traditional supervised techniques, offering a robust, data-efficient pathway for discovering new, anomalous transients, and classifying complex noise artifacts in the era of next-generation detectors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。