arXiv:2510.18890cs.CLcs.AI2025-10被引 2

用小型模型高效检索地学文献中的精准信息,成本低且结果可信。

Small Language Models Offer Significant Potential for Science Community

  • 用微型语言模型实现地学文献的语义搜索与句子级索引。
  • 从7700万条高质量句中准确提取定量研究成果,优于大模型泛化回答。
  • 可追踪研究趋势、情绪变化和新兴问题,适合科研与教育场景。

近期自然语言处理的进步,特别是大规模语言模型(LLMs)的发展,正在改变科学家获取文献的方式。尽管LLM使用日益广泛,但存在信息偏差和计算成本高的担忧。本文提出一种框架,评估利用免费的小型语言模型(MiniLMs)在大规模地学文献中实现精确、快速、低成本信息检索的可行性。构建了一个包含约7700万条高质量句子的精选语料库,数据源自2000至2024年间95本主流地学期刊(如Geophysical Research Letters、Earth and Planetary Science Letters)。MiniLM通过语义搜索和句子级索引,实现对领域特定信息的高效提取。相比ChatGPT-4等大模型常给出泛化回答,MiniLM更擅长识别大量经过专家验证、来源多学科交叉的定量研究成果。此外,通过情感分析和无监督聚类,可有效追踪地学领域结论演变、研究重点转移、技术进展及新兴科学问题。总体而言,MiniLM在地学领域具有显著潜力,适用于事实与图像检索、趋势分析、矛盾检测及教学应用。

原文摘要 · Abstract (English)

Recent advancements in natural language processing, particularly with large language models (LLMs), are transforming how scientists engage with the literature. While the adoption of LLMs is increasing, concerns remain regarding potential information biases and computational costs. Rather than LLMs, I developed a framework to evaluate the feasibility of precise, rapid, and cost-effective information retrieval from extensive geoscience literature using freely available small language models (MiniLMs). A curated corpus of approximately 77 million high-quality sentences, extracted from 95 leading peer-reviewed geoscience journals such as Geophysical Research Letters and Earth and Planetary Science Letters published during years 2000 to 2024, was constructed. MiniLMs enable a computationally efficient approach for extracting relevant domain-specific information from these corpora through semantic search techniques and sentence-level indexing. This approach, unlike LLMs such as ChatGPT-4 that often produces generalized responses, excels at identifying substantial amounts of expert-verified information with established, multi-disciplinary sources, especially for information with quantitative findings. Furthermore, by analyzing emotional tone via sentiment analysis and topical clusters through unsupervised clustering within sentences, MiniLM provides a powerful tool for tracking the evolution of conclusions, research priorities, advancements, and emerging questions within geoscience communities. Overall, MiniLM holds significant potential within the geoscience community for applications such as fact and image retrievals, trend analyses, contradiction analyses, and educational purposes.

小模型地学信息检索语义搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。