arXiv:2603.24825cs.SEcs.AI2026-03

用开发者历史讨论训练智能系统,自动验证Linux内核补丁

Learning From Developers: Towards Reliable Patch Validation at Scale for Linux

  • 基于历史评审对话提炼规则,结合无需训练的LLM进行补丁分析
  • 在v6.18中发现2个新问题,对并发错误覆盖率达基线21%以上
  • 误报率低至35%,适合内核开发与大规模代码审查场景

补丁评审是开源软件开发的关键环节,尤其在依赖志愿贡献的Linux项目中。本文研究了过去十年Linux内存管理子系统的补丁评审过程,发现尽管已有多种自动化工具,评审仍高度依赖人工,且少数开发者承担了主要审查工作。为提升评审效率,我们提出FLINT框架,通过多阶段方法从历史开发者讨论中提炼有效验证规则,并利用无需训练的LLM自动分析新补丁,生成可解释的参考报告。FLINT能检测传统工具难以发现的问题,包括可维护性缺陷(如设计选择、命名规范)和复杂并发问题(如死锁、数据竞争)。在Linux v6.18开发周期中发现2个新问题,在旧版本中发现7个。相比仅用LLM的基线,FLINT在并发错误上的真实覆盖率分别提高21%和14%;同时误报率仅为35%,低于基线。

原文摘要 · Abstract (English)

Patch reviewing is critical for software development, especially in distributed open-source development, which highly depends on voluntary work, such as Linux. This paper studies the past 10 years of patch reviews of the Linux memory management subsystem to characterize the challenges involved in patch reviewing at scale. Our study reveals that the review process is still primarily reliant on human effort despite a wide-range of automatic checking tools. Although kernel developers strive to review all patch proposals, they struggle to keep up with the increasing volume of submissions and depend significantly on a few developers for these reviews. To help scale the patch review process, we introduce FLINT, a patch validation system framework that synthesizes insights from past discussions among developers and automatically analyzes patch proposals for compliance. FLINT employs a rule-based analysis informed by past discussions among developers and an LLM that does not require training or fine-tuning on new data, and can continuously improve with minimum human effort. FLINT uses a multi-stage approach to efficiently distill the essential information from past discussions. Later, when a patch proposal needs review, FLINT retrieves the relevant validation rules for validation and generates a reference-backed report that developers can easily interpret and validate. FLINT targets bugs that traditional tools find hard to detect, ranging from maintainability issues, e.g., design choices and naming conventions, to complex concurrency issues, e.g., deadlocks and data races. FLINT detected 2 new issues in Linux v6.18 development cycle and 7 issues in previous versions. FLINT achieves 21% and 14% of higher ground-truth coverage on concurrency bugs than the baseline with LLM only. Moreover, FLINT achieves a 35% false positive rate, which is lower than the baseline.

内核开发补丁验证LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。