用自监督学习提升射电天文图像分类,效果优于传统预训练模型。
Self-supervised learning for radio-astronomy source classification: a benchmark
- 采用自监督学习从海量无标签射电图像中提取有效特征
- 在多个下游任务中,自监督模型显著优于自然图像预训练基线
- 适合射电天文数据量大但标注少的研究者使用
即将启用的平方公里阵列(SKA)望远镜为射电天文学带来了新的机遇与挑战。传统基于光学摄影图像预训练的视觉模型在射电干涉图像上表现不佳,因其具有独特的视觉特征。自监督学习(SSL)利用射电天文数据中丰富的无标签样本,可有效训练神经网络以学习有用表征。本研究探索了SSL在射电天文学中的应用,比较了SSL训练模型与自然图像预训练模型的性能,评估了数据清洗对SSL的重要性,并考察了自监督学习在不同领域特定射电天文数据集上的潜力。结果表明,SSL模型在多个下游任务中表现显著优于基线,尤其在线性评估设置下;当整个主干网络微调时,优势减弱但仍优于预训练模型。这些发现表明,自监督学习能有效提升射电天文数据的分析效率。训练模型与代码已公开:https://github.com/dr4thmos/solo-learn-radio。
原文摘要 · Abstract (English)
The upcoming Square Kilometer Array (SKA) telescope marks a significant step forward in radio astronomy, presenting new opportunities and challenges for data analysis. Traditional visual models pretrained on optical photography images may not perform optimally on radio interferometry images, which have distinct visual characteristics. Self-Supervised Learning (SSL) offers a promising approach to address this issue, leveraging the abundant unlabeled data in radio astronomy to train neural networks that learn useful representations from radio images. This study explores the application of SSL to radio astronomy, comparing the performance of SSL-trained models with that of traditional models pretrained on natural images, evaluating the importance of data curation for SSL, and assessing the potential benefits of self-supervision to different domain-specific radio astronomy datasets. Our results indicate that, SSL-trained models achieve significant improvements over the baseline in several downstream tasks, especially in the linear evaluation setting; when the entire backbone is fine-tuned, the benefits of SSL are less evident but still outperform pretraining. These findings suggest that SSL can play a valuable role in efficiently enhancing the analysis of radio astronomical data. The trained models and code is available at: \url{https://github.com/dr4thmos/solo-learn-radio}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。