arXiv:2608.12144cs.SEcs.LG2026-08

统一整合深度学习测试覆盖率评估工具,方便复现与应用。

ADEPT: A Unified Framework for Deep Learning Test Adequacy

论文配图:ADEPT: A Unified Framework for Deep Learning Test Adequacy
图 1 · 摘自论文原文
  • 构建统一框架集成多种覆盖率度量方法
  • 支持配置管理与结果结构化输出
  • 适合研究者快速复现和部署测试工具

过去十年中,研究者提出了多种深度学习测试充分性度量方法,从神经元激活、潜在特征覆盖、决策边界探索等不同角度评估测试数据集的充分性。然而,这些度量通常以独立的研究原型形式发布,存在安装、预处理、执行流程和配置方式各异的问题,导致复现、比较和实际应用困难。本文介绍ADEPT框架的工程实现,整合了基于神经元覆盖率、意外性充分性、输入分布覆盖、边界覆盖以及源码和模型级变异得分等多种代表性技术,采用一致的执行流程。ADEPT提供基于模板的度量接口、可扩展的插槽设计,并支持YAML配置管理、预处理缓存复用和结构化结果报告,显著降低使用门槛。该框架旨在帮助研究人员和实践者无需耗费数日或数周时间搭建工具链,即可高效复现与应用各类测试充分性度量。演示视频见 https://aub.ie/ADEPT_video。

原文摘要 · Abstract (English)

Over the past decade, many test adequacy metrics have been proposed for deep learning that characterize test dataset adequacy from different perspectives, e.g., neuron activation behavior, latent feature coverage, decision-boundary exploration, etc. However, these metrics are typically released as independent research prototypes with substantially different installation and preprocessing requirements, execution workflows, and configuration mechanisms. These complications make them quite difficult to reproduce, compare, and adopt in research work and practical deployment alike. In this paper, we present the engineering details of ADEPT, a framework that integrates representative adequacy techniques, including neuron-coverage-based metrics, surprise adequacy, input distribution coverage, boundary coverage, and source- and model-level mutation score, under a consistent execution workflow. ADEPT provides a template-based metric interface with well-defined extension points for integrating new adequacy metrics. Furthermore, it provides YAML-based configuration management, preprocessing-cache reuse, and structured result reporting, making it easy to use in any research and development workflows. ADEPT is designed for researchers and practitioners who wish to reproduce and apply adequacy metrics without spending days or weeks implementing missing tooling or configuring disparate research prototypes. A demo video is available at https://aub.ie/ADEPT_video.

测试充分性深度学习框架可复现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。