小模型也能做好科研助手,靠的是智能检索和任务路由。
Do We Need Bigger Models for Science? Task-Aware Retrieval with Small Language Models
- 根据任务类型自动选择检索策略,提升信息匹配精度。
- 小模型配合精心设计的检索系统,问答准确率接近大模型。
- 适合追求可复现、低成本的学术研究者使用。
科学知识发现日益依赖大语言模型,但现有学术助手多基于数十亿甚至数百亿参数的专有系统,限制了研究社区的可复现性与可及性。本文探讨:科学应用是否必须依赖更大模型?我们设计了一种轻量级检索增强框架,通过任务感知路由机制,根据输入查询选择专用检索策略。系统整合全文科学论文与结构化学术元数据,利用紧凑的指令微调语言模型生成带引用的回答。在多个学术任务上评估,包括单/多文档问答、跨领域生物医学问答及科学文本压缩。结果表明,检索设计与模型规模是互补而非替代关系;虽优化检索可部分弥补小模型不足,但复杂推理仍需足够模型容量。本工作强调检索与任务感知设计对构建实用、可复现学术助手的关键作用。
原文摘要 · Abstract (English)
Scientific knowledge discovery increasingly relies on large language models, yet many existing scholarly assistants depend on proprietary systems with tens or hundreds of billions of parameters. Such reliance limits reproducibility and accessibility for the research community. In this work, we ask a simple question: do we need bigger models for scientific applications? Specifically, we investigate to what extent carefully designed retrieval pipelines can compensate for reduced model scale in scientific applications. We design a lightweight retrieval-augmented framework that performs task-aware routing to select specialized retrieval strategies based on the input query. The system further integrates evidence from full-text scientific papers and structured scholarly metadata, and employs compact instruction-tuned language models to generate responses with citations. We evaluate the framework across several scholarly tasks, focusing on scholarly question answering (QA), including single- and multi-document scenarios, as well as biomedical QA under domain shift and scientific text compression. Our findings demonstrate that retrieval and model scale are complementary rather than interchangeable. While retrieval design can partially compensate for smaller models, model capacity remains important for complex reasoning tasks. This work highlights retrieval and task-aware design as key factors for building practical and reproducible scholarly assistants.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。