用大模型和检索增强生成，自动验证代码是否与论文一致
Enhancing Code Consistency in AI Research with Large Language Models and Retrieval-Augmented Generation
- 结合论文与代码，通过检索增强生成提取关键信息
- 利用大模型进行结构化比对，提升验证准确性和全面性
- 适合关注可复现性与研究可信度的AI开发者
确保代码准确反映论文中描述的算法和方法，对维护AI研究的可信度至关重要。本文提出一种新系统，用于验证代码实现与对应研究论文中的算法和方法的一致性。该系统采用检索增强生成技术，从论文和代码库中提取相关细节，再通过大语言模型进行结构化比对。该方法提升了代码实现验证的准确性与全面性，有助于提高AI研究的透明度、可解释性与可复现性。通过自动化验证流程，系统减少了人工工作量，增强了研究可信度，推动了代码验证领域的进步。
原文摘要 · Abstract (English)
Ensuring that code accurately reflects the algorithms and methods described in research papers is critical for maintaining credibility and fostering trust in AI research. This paper presents a novel system designed to verify code implementations against the algorithms and methodologies outlined in corresponding research papers. Our system employs Retrieval-Augmented Generation to extract relevant details from both the research papers and code bases, followed by a structured comparison using Large Language Models. This approach improves the accuracy and comprehensiveness of code implementation verification while contributing to the transparency, explainability, and reproducibility of AI research. By automating the verification process, our system reduces manual effort, enhances research credibility, and ultimately advances the state of the art in code verification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。