arXiv:2510.06931astro-ph.IMcs.LG2025-10被引 7

用大模型生成可读描述,让天文图像分类既准又透明

Textual interpretation of transient image classifications from large language models

  • 用少量示例和自然语言指令,让大模型直接生成候选天体的文本描述
  • 在三个巡天数据集上平均准确率达93%,接近传统神经网络水平
  • 支持人机交互式修正,适合需要可解释性的天文观测与研究者

现代天文巡天产生海量暂现源数据,但区分真实天体信号与成像伪影仍具挑战。虽然卷积神经网络能有效分类真假,但其黑箱特性难以解释。本文展示大型语言模型(LLM)可在三个光学暂现源巡天数据集(Pan-STARRS、MeerLICHT 和 ATLAS)上达到与卷积神经网络相当的性能,同时为每个候选对象生成直接可读的文本描述。仅需15个示例和简洁指令,谷歌的Gemini模型在跨分辨率和像素尺度的数据上实现了93%的平均准确率。此外,第二个模型可评估第一个模型输出的一致性,实现问题案例的迭代优化。该框架允许用户通过自然语言和示例定义分类行为,跳过传统训练流程。通过生成观测特征的文本描述,大模型使用户能如查询标注目录般检索分类结果,而非解读抽象的隐空间。随着下一代望远镜和巡天数据量激增,基于大模型的分类有望弥合自动化检测与人类可理解性之间的鸿沟。

原文摘要 · Abstract (English)

Modern astronomical surveys deliver immense volumes of transient detections, yet distinguishing real astrophysical signals (for example, explosive events) from bogus imaging artefacts remains a challenge. Convolutional neural networks are effectively used for real versus bogus classification; however, their reliance on opaque latent representations hinders interpretability. Here we show that large language models (LLMs) can approach the performance level of a convolutional neural network on three optical transient survey datasets (Pan-STARRS, MeerLICHT and ATLAS) while simultaneously producing direct, human-readable descriptions for every candidate. Using only 15 examples and concise instructions, Google's LLM, Gemini, achieves a 93% average accuracy across datasets that span a range of resolution and pixel scales. We also show that a second LLM can assess the coherence of the output of the first model, enabling iterative refinement by identifying problematic cases. This framework allows users to define the desired classification behaviour through natural language and examples, bypassing traditional training pipelines. Furthermore, by generating textual descriptions of observed features, LLMs enable users to query classifications as if navigating an annotated catalogue, rather than deciphering abstract latent spaces. As next-generation telescopes and surveys further increase the amount of data available, LLM-based classification could help bridge the gap between automated detection and transparent, human-level understanding.

大模型天文可解释性分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。