用用户反馈迭代优化RAG系统,让模型越用越准。
Enhancing LLMs through human feedback: a journey towards self-improvement

- 引入辅助反馈RAG系统,持续收集并整合用户反馈
- 在三个数据集上验证,显著提升回答准确性和相关性
- 适合关注自进化AI系统的研究人员和产品开发者
在信息检索系统快速演进的背景下,通过用户反馈实现自适应改进至关重要。本研究提出一种新方法,通过战略性地整合一个辅助反馈RAG系统,来优化主RAG系统的性能。该方法基于人机协同机制,持续收集、分类并融入用户反馈,使系统在推理流程中实现迭代学习与演化。为验证有效性,研究在三个涵盖通用与特定领域知识的基准数据集上进行严格测试,并采用LLM-as-a-Judge评估策略。结果表明,该框架不仅凸显了反馈驱动增强在RAG系统中的变革潜力,也为未来自适应信息检索技术研究树立了范例,标志着向通过用户参与实现自主优化迈出关键一步。
原文摘要 · Abstract (English)
In the rapidly evolving landscape of information retrieval systems, the ability to adapt and improve through user feedback is paramount. This study introduces a novel methodology for refining the performance of a primary Retrieval Augmented Generation (RAG) system by strategically integrating an auxiliary feedback RAG system. By systematically harnessing human-generated feedback, the approach aims to enhance the accuracy, relevance, and overall quality of responses, driving the system towards self-improvement. Central to this methodology is a human-in-the-loop implementation, where user feedback is continuously collected, classified, and integrated into the inference workflow, enabling the system to learn and evolve iteratively. To validate the effectiveness of this approach, the study employs rigorous testing against three diverse benchmark datasets focused on general and custom domain knowledge, utilizing a LLM-as-a-Judge evaluation strategy. This comprehensive framework not only underscores the transformative potential of feedback-driven enhancements in RAG systems but also sets a precedent for future research in adaptive information retrieval technologies, marking a significant step in the journey towards autonomous refinement and optimization through user engagement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。