实证分析npm生态安全实践对漏洞修复与更新效率的影响
Assumptions to Evidence: Evaluating Security Practices Adoption and Their Impact on Outcomes in the npm Ecosystem
- 基于145万npm包数据,用Scorecard指标量化安全实践采纳度
- 综合采纳安全实践可减少5.2个漏洞,缩短216.8天修复时间
- 大型活跃项目采纳安全实践效果更显著,适合开发者与政策制定者参考
从业者常面临网络安全框架中大量安全实践带来的选择困境。在资源有限的情况下,亟需基于实证证据优先采纳有效实践。本研究通过分析145,000个npm包的安全部署情况及其对安全结果的影响,评估安全实践采纳与安全指标之间的关系。采用OpenSSF Scorecard指标自动衡量npm GitHub仓库中安全实践的采纳程度,并考察项目级安全结果:开放漏洞数(Vul_Count)、依赖漏洞平均修复时间(MTTR)和依赖平均更新时间(MTTU)。利用11个Scorecard指标及汇总得分作为预测变量,对上述三项指标进行回归与因果分析。结果显示,综合采纳安全实践可带来5.2个漏洞减少、MTTR缩短216.8天、MTTU缩短52.3天。此外,项目特征显著影响实践效果:成熟、活跃、规模大、贡献者多、依赖少、下载量高的仓库,在采纳安全实践后表现更优。
原文摘要 · Abstract (English)
Practitioners often struggle with the overwhelming number of security practices outlined in cybersecurity frameworks for risk mitigation. Given the limited budget, time, and resources, practitioners want to prioritize the adoption of security practices based on empirical evidence. The goal of this study is to assist practitioners and policymakers in making informed decisions on which security practices to adopt by evaluating the relationship between software security practices adoption and security outcome metrics. To do this, we analyzed the adoption of security practices and their impact on security outcome metrics across 145K npm packages. We selected the OpenSSF Scorecard metrics to automatically measure the adoption of security practices in npm GitHub repositories. We also investigated project-level security outcome metrics: the number of open vulnerabilities (Vul_Count)), mean time to remediate (MTTR) vulnerabilities in dependencies, and mean time to update (MTTU) dependencies. We conducted regression and causal analysis using 11 Scorecard metrics and the aggregated Scorecard score (computed by aggregating individual security practice scores) as predictors and Vul_Count), MTTR, and MTTU as target variables. Our findings reveal that aggregated adoption of security practices is associated with 5.2 fewer vulnerabilities, 216.8 days faster MTTR, and 52.3 days faster MTTU. Repository characteristics have an impact on security practice effectiveness: repositories with high security practice adoptions, especially those that are mature, actively maintained, large in size, have many contributors, few dependencies, and high download volumes, tend to exhibit better outcomes compared to smaller or inactive repositories.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。