Argus通过多智能体协作降低代码泄露检测误报率。
Argus: A Multi-Agent Sensitive Information Leakage Detection Framework Based on Hierarchical Reference Relationships
- 构建三级检测机制,融合内容、上下文与项目引用关系
- 漏报率94.64%,精确率达96.36%,F1值0.955
- 适用于开源项目安全审计与开发团队自动化防护
代码仓库中的敏感信息泄露已成为关键安全挑战。传统基于正则表达式、指纹特征和高熵计算的检测方法常导致高误报率,不仅降低检测效率,还大幅增加开发者的人工筛查负担。近年来,大语言模型(LLMs)与多智能体协同架构在处理复杂任务方面展现出显著潜力,为敏感信息检测提供了新思路。针对上述问题,我们提出Argus——一种多智能体协同的敏感信息检测框架。Argus采用三层检测机制,整合关键内容、文件上下文及项目引用关系,有效降低误报并提升整体检测精度。为全面评估在真实仓库环境中的表现,我们构建了两个新基准:一个用于评估真实泄漏检测能力,另一个用于衡量误报过滤性能。实验结果表明,Argus在泄漏检测中最高达94.86%准确率,精确率96.36%,召回率94.64%,F1分数0.955。对97个真实仓库的分析总成本仅为2.2美元。所有代码实现与相关数据集已公开于https://github.com/TheBinKing/Argus-Guard,供后续研究与应用。
原文摘要 · Abstract (English)
Sensitive information leakage in code repositories has emerged as a critical security challenge. Traditional detection methods that rely on regular expressions, fingerprint features, and high-entropy calculations often suffer from high false-positive rates. This not only reduces detection efficiency but also significantly increases the manual screening burden on developers. Recent advances in large language models (LLMs) and multi-agent collaborative architectures have demonstrated remarkable potential for tackling complex tasks, offering a novel technological perspective for sensitive information detection. In response to these challenges, we propose Argus, a multi-agent collaborative framework for detecting sensitive information. Argus employs a three-tier detection mechanism that integrates key content, file context, and project reference relationships to effectively reduce false positives and enhance overall detection accuracy. To comprehensively evaluate Argus in real-world repository environments, we developed two new benchmarks, one to assess genuine leak detection capabilities and another to evaluate false-positive filtering performance. Experimental results show that Argus achieves up to 94.86% accuracy in leak detection, with a precision of 96.36%, recall of 94.64%, and an F1 score of 0.955. Moreover, the analysis of 97 real repositories incurred a total cost of only 2.2$. All code implementations and related datasets are publicly available at https://github.com/TheBinKing/Argus-Guard for further research and application.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。