arXiv:2508.11386cs.CLcs.AI2025-08被引 2

用轻量模型实现精准领域问答,兼顾性能与隐私。

Retrieval-augmented reasoning with lean language models

  • 轻量模型结合检索增强,本地部署不依赖大模型
  • 在英国医疗指南数据上准确率逼近顶尖模型
  • 适合资源受限或需保护隐私的场景使用

本技术报告提出一种新型方法,将推理与检索增强生成(RAG)整合到单一轻量级语言模型架构中。针对现有RAG系统依赖大型模型和外部API的问题,本文设计了一种可在资源受限或高安全环境中部署的高效解决方案。基于测试时扩展与小型推理模型的进展,系统采用细调后的Qwen2.5-Instruct作为主干模型,结合密集检索器,利用前沿模型(如DeepSeek-R1)生成合成查询与推理轨迹,在英国国家医疗服务体系(NHS A-to-Z)条件页面语料库上进行训练。研究探索了摘要式文档压缩、合成数据设计及推理感知微调对性能的影响。实验表明,相比非推理型和通用轻量模型,该领域特定微调方法显著提升答案准确率与一致性,接近前沿水平,同时具备本地部署可行性。所有实现细节与代码均已公开,支持跨领域复现与适配。

原文摘要 · Abstract (English)

This technical report details a novel approach to combining reasoning and retrieval augmented generation (RAG) within a single, lean language model architecture. While existing RAG systems typically rely on large-scale models and external APIs, our work addresses the increasing demand for performant and privacy-preserving solutions deployable in resource-constrained or secure environments. Building on recent developments in test-time scaling and small-scale reasoning models, we develop a retrieval augmented conversational agent capable of interpreting complex, domain-specific queries using a lightweight backbone model. Our system integrates a dense retriever with fine-tuned Qwen2.5-Instruct models, using synthetic query generation and reasoning traces derived from frontier models (e.g., DeepSeek-R1) over a curated corpus, in this case, the NHS A-to-Z condition pages. We explore the impact of summarisation-based document compression, synthetic data design, and reasoning-aware fine-tuning on model performance. Evaluation against both non-reasoning and general-purpose lean models demonstrates that our domain-specific fine-tuning approach yields substantial gains in answer accuracy and consistency, approaching frontier-level performance while remaining feasible for local deployment. All implementation details and code are publicly released to support reproducibility and adaptation across domains.

轻量模型检索增强医疗问答

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。