用AI智能导航数据科学文献，精准找论文更高效。
A Retrieval-Augmented Generation Framework for Academic Literature Navigation in Data Science
- 结合文献提取与语义分块，提升检索相关性。
- 在RAGAS评测中上下文相关性显著提升。
- 适合科研人员快速定位关键文献。
在快速发展的数据科学领域，高效导航海量学术文献对决策与创新至关重要。本文提出一种增强型检索增强生成（RAG）系统，利用AI技术辅助数据科学家精准获取相关学术资源。该系统融合GROBID文献信息提取、微调嵌入模型、语义分块及摘要优先检索策略，显著提升检索结果的相关性与准确性。通过基于RAGAS评估框架的综合测试，关键指标如上下文相关性得到明显改善，有效缓解信息过载，优化决策流程。研究结果表明，该系统具备变革数据科学文献探索方式的潜力，可推动科研与创新工作流升级。
原文摘要 · Abstract (English)
In the rapidly evolving field of data science, efficiently navigating the expansive body of academic literature is crucial for informed decision-making and innovation. This paper presents an enhanced Retrieval-Augmented Generation (RAG) application, an artificial intelligence (AI)-based system designed to assist data scientists in accessing precise and contextually relevant academic resources. The AI-powered application integrates advanced techniques, including the GeneRation Of BIbliographic Data (GROBID) technique for extracting bibliographic information, fine-tuned embedding models, semantic chunking, and an abstract-first retrieval method, to significantly improve the relevance and accuracy of the retrieved information. This implementation of AI specifically addresses the challenge of academic literature navigation. A comprehensive evaluation using the Retrieval-Augmented Generation Assessment System (RAGAS) framework demonstrates substantial improvements in key metrics, particularly Context Relevance, underscoring the system's effectiveness in reducing information overload and enhancing decision-making processes. Our findings highlight the potential of this enhanced Retrieval-Augmented Generation system to transform academic exploration within data science, ultimately advancing the workflow of research and innovation in the field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。