arXiv:2502.15134cs.CLcs.AI2025-02NAACL被引 5

用简单文档可靠性排序替代复杂推理,提升小模型在边缘设备上的领域专用问答能力。

Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device

  • 用文档可靠性排名替代链式推理,降低计算开销。
  • 在多个基准上达到当前最优性能,准确率保持高位。
  • 适合资源受限的边缘设备部署,尤其适用于个性化等特定任务。

基于大语言模型(LLMs)的检索增强生成(RAG)在专业领域中尤为重要,因精度要求高。为使LLM更适应目标领域,领域专用RAG通过微调使模型早期访问目标领域知识。该方法在资源受限的边缘设备环境中尤为适用,因其可利用小型模型可靠执行特定任务(如个性化)。尽管领域专用RAG与边缘设备高度契合,但通常依赖链式思维(CoT)等广泛使用的推理技术。然而,推理步骤虽有助于理解外部知识,却计算成本高,且小型模型难以学习。为此,本文提出链式排序(Chain of Rank, CoR),将重点从冗长复杂的推理转向对输入外部文档可靠性的简单排序。此方法显著降低计算复杂度,同时保持高精度,特别适合资源受限环境。我们在多个基准测试中取得当前最优结果,并分析其有效性。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) with large language models (LLMs) is especially valuable in specialized domains, where precision is critical. To more specialize the LLMs into a target domain, domain-specific RAG has recently been developed by allowing the LLM to access the target domain early via finetuning. The domain-specific RAG makes more sense in resource-constrained environments like edge devices, as they should perform a specific task (e.g. personalization) reliably using only small-scale LLMs. While the domain-specific RAG is well-aligned with edge devices in this respect, it often relies on widely-used reasoning techniques like chain-of-thought (CoT). The reasoning step is useful to understand the given external knowledge, and yet it is computationally expensive and difficult for small-scale LLMs to learn it. Tackling this, we propose the Chain of Rank (CoR) which shifts the focus from intricate lengthy reasoning to simple ranking of the reliability of input external documents. Then, CoR reduces computational complexity while maintaining high accuracy, making it particularly suited for resource-constrained environments. We attain the state-of-the-art (SOTA) results in benchmarks, and analyze its efficacy.

RAG边缘计算小模型排序

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。