用AI助手自动审代码,让开发提效40%以上。
DeputyDev -- AI Powered Developer Assistant: Breaking the Code Review Logjam through Contextual AI to Boost Developer Productivity
- 用上下文感知的AI自动生成代码评审意见
- 平均审代码时间减少23.09%,每行代码减少40.13%
- 适合希望缩短代码审查周期的团队和企业
本研究探讨了AI驱动的代码审查助手DeputyDev的实现与效果,旨在解决软件开发中代码审查效率低下的问题。在TATA 1mg的实践中,拉取请求(PR)的平均领取和审查时间分别为73小时和82小时,导致平均关闭周期达6.2天,且存在反复沟通延迟。加州大学欧文分校的研究表明,中断会带来平均23分钟的注意力损失,影响代码质量与交付速度。为此,我们开发了基于上下文的自动化代码审查功能。通过涵盖200多名工程师的双对照A/B实验,结果显示,平均每个PR的审查时间减少23.09%,每行代码的审查时间减少40.13%。剔除异常值后,DeputyDev已在全公司上线,并作为SaaS服务向外部企业提供,支撑众多工程师日常开发工作。该研究验证了AI辅助代码审查在优化开发流程、提升代码质量方面的有效性。
原文摘要 · Abstract (English)
This study investigates the implementation and efficacy of DeputyDev, an AI-powered code review assistant developed to address inefficiencies in the software development process. The process of code review is highly inefficient for several reasons, such as it being a time-consuming process, inconsistent feedback, and review quality not being at par most of the time. Using our telemetry data, we observed that at TATA 1mg, pull request (PR) processing exhibits significant inefficiencies, with average pick-up and review times of 73 and 82 hours, respectively, resulting in a 6.2 day closure cycle. The review cycle was marked by prolonged iterative communication between the reviewing and submitting parties. Research from the University of California, Irvine indicates that interruptions can lead to an average of 23 minutes of lost focus, critically affecting code quality and timely delivery. To address these challenges, we developed DeputyDev's PR review capabilities by providing automated, contextual code reviews. We conducted a rigorous double-controlled A/B experiment involving over 200 engineers to evaluate DeputyDev's impact on review times. The results demonstrated a statistically significant reduction in both average per PR (23.09%) and average per-line-of-code (40.13%) review durations. After implementing safeguards to exclude outliers, DeputyDev has been effectively rolled out across the entire organisation. Additionally, it has been made available to external companies as a Software-as-a-Service (SaaS) solution, currently supporting the daily work of numerous engineering professionals. This study explores the implementation and effectiveness of AI-assisted code reviews in improving development workflow timelines and code.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。