arXiv:2605.25039cs.CV2026-05中稿 · IEEE CAI 2026

用网页排名优化天文问答,提升大模型准确率。

AstroRAG -- A Pagerank-Based Retrieval-Augmented Generation Pipeline for Question Answering in Astronomy

论文配图:AstroRAG -- A Pagerank-Based Retrieval-Augmented Generation Pipeline for Question Answering in Astronomy
图 1 · 摘自论文原文
  • 基于页面排名重排检索结果,筛选互支撑的精炼上下文。
  • 在AstroQA上使Mistral-7B准确率和F1达79.49%,翻倍提升。
  • 无需训练、保护隐私,适合科学领域问答系统部署。

大型语言模型在自然语言处理中表现强劲,但仅依赖参数化知识时常产生事实错误。检索增强生成(RAG)通过引入外部证据缓解此类问题,但传统“检索-拼接”方法常引入无关内容,降低答案质量。本文提出AstroRAG——一种专用于天文学问答的基于页面排名的RAG流程。系统采用词元感知分块与实例级瞬时索引,通过两阶段检索:(i) 最大边际相关性(MMR)获取小而多样的候选集;(ii) 读者驱动的页面排名(PR)在相似性图上重排序,识别紧凑且相互支持的上下文,严格控制在有限词元预算内。该设计无须训练、保障隐私、可复现,每个实例通过临时索引处理,防止跨任务泄露。我们在天文学问答基准AstroQA上评估,结果显示增强后的Mistral-7B达到79.49%准确率和79.49% F1分数,近乎是其非RAG版本的两倍。这表明严谨的检索与优化能显著提升特定领域的推理能力,为将RAG拓展至其他科学领域奠定坚实基础。

原文摘要 · Abstract (English)

Large language models (LLMs) demonstrate strong performance in natural language processing but often generate factual errors when relying solely on parametric knowledge. Retrieval-Augmented Generation (RAG) mitigates these errors by grounding responses in external evidence, yet conventional retrieve-and-dump approaches frequently introduce irrelevant context that degrades answer quality. In this work, we present AstroRAG -- a PageRank-based retrieval-augmented generation (RAG) pipeline adapted for question answering in astronomy. The system performs token-aware chunking and per-instance, ephemeral indexing in Elasticsearch, then executes a two-stage retrieval: (i) Maximal Marginal Relevance (MMR) to obtain a small, diverse candidate set and (ii) a reader-driven PageRank (PR) re-ranking on a similarity graph to identify a compact, mutually supportive context under a strict token budget. Our design is training-free, privacy-preserving, and reproducible, as each instance is processed through transient indexing to prevent cross-task leakage. We evaluate the pipeline on the AstroQA benchmark for astronomy QA, and demonstrate competitive performance across all difficulty levels. In particular, the RAG-enhanced Mistral-7B achieves \textbf{79.49\% accuracy} and \textbf{79.49\% F1-score}, nearly doubling the performance of its non-RAG counterpart. These results highlight the effectiveness of disciplined retrieval and refinement in boosting domain-specific reasoning, establishing a robust foundation for extending RAG to other scientific fields.

RAG天文学信息检索大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。