对比评估RAG、LoRA和DoRA在真实问答场景中的准确率与效率表现。
Hallucinations and Truth: A Comprehensive Accuracy Evaluation of RAG, LoRA and DoRA
- 通过2万条问答数据,测试三类方法在40万条知识库上的表现。
- DoRA在准确率(90.1%)和延迟(110毫秒)上均最优。
- 适合对准确性要求高的医疗、金融等专业领域部署使用。
生成式AI的进展显著提升了自然语言处理系统的效率与适应性,尤其体现在检索增强生成(RAG)、低秩适配(LoRA)和权重分解低秩适配(DoRA)上。RAG通过引入外部知识提升生成内容的事实一致性,LoRA实现大语言模型(LLM)的参数高效微调,DoRA则通过自适应参数排序与领域感知权重调整进一步优化微调过程,兼顾学习效率与推理性能。本文对RAG、LoRA和DoRA进行了大规模实证评估,基于20,000条问答查询,在包含40万条条目的知识库上测试模型微调与生成性能。研究分析了准确率、相关性与推理延迟等关键指标。实验结果表明,DoRA在准确率(90.1%)、相关性得分(0.88)和延迟(每查询110毫秒)方面均优于LoRA与RAG,适用于真实场景中的领域特定生成式AI应用。此外,研究还考察了不同模型在微调效率、计算成本与实时适应性之间的权衡。结果显示,RAG在知识锚定方面有效,LoRA实现低成本领域适配,而DoRA能平衡微调效率与模型精度。这些发现为医疗、金融、法律等高可靠性要求领域的生成式AI系统部署提供了实践指导。
原文摘要 · Abstract (English)
Recent advancements in Generative AI have significantly improved the efficiency and adaptability of natural language processing (NLP) systems, particularly through Retrieval-Augmented Generation (RAG), Low-Rank Adaptation (LoRA), and Weight-Decomposed Low-Rank Adaptation (DoRA). RAG integrates external knowledge to enhance factual consistency in generative outputs, while LoRA enables parameter-efficient fine-tuning of large language models (LLMs). DoRA further refines this process by optimizing fine-tuning through adaptive parameter ranking and domain-aware weight adjustments, improving learning efficiency while maintaining inference performance. This paper presents a large-scale empirical evaluation of RAG, LoRA, and DoRA, with model fine-tuning and generation performance assessed on 20,000 FAQ-based queries, while the knowledge base spans 400,000 entries. The study analyzes key performance metrics such as accuracy, relevance, and inference latency. Experimental results demonstrate that DoRA achieves the highest accuracy (90.1%), relevance score (0.88), and lowest latency (110 ms per query), outperforming both LoRA and RAG in real-world, domain-specific generative AI applications. Furthermore, this study examines the trade-offs between fine-tuning efficiency, computational cost, and real-time adaptability across different models. Findings highlight RAG's effectiveness in knowledge grounding, LoRA's cost-efficient domain adaptation, and DoRA's ability to balance fine-tuning efficiency with model precision. These insights provide practical guidance for deploying AI-driven generative systems in accuracy-critical domains such as healthcare, finance, and legal services, ensuring scalability, reliability, and optimal performance in dynamic environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。