提出新型对抗攻击CONSERVAttack,发现粒子物理中模型潜在漏洞
Shapes are not enough: CONSERVAttack and its use for finding vulnerabilities and uncertainties in machine learning applications
- 设计对抗攻击捕捉模拟与数据间未被检测的偏差
- 扰动在误差范围内,却能成功欺骗深度学习模型
- 提醒粒子物理研究需重视模型对抗鲁棒性
在高能物理等领域,深度学习广泛用于分析仿真与实验数据。尽管已有针对物理动机的系统性不确定性测试,包括对控制区域中边际分布和特征相关性的比较,但仍无法保证所有潜在偏差都被覆盖。为此,本文提出CONSERVAttack,一种旨在挖掘现有验证框架之外假设性差异的对抗攻击。其生成的扰动符合不确定性范围,可逃避常规验证,却仍能有效欺骗模型。文中还提出了缓解策略,并强调在粒子物理的深度学习应用中,必须将对抗鲁棒性纳入结果解释考量。
原文摘要 · Abstract (English)
In High Energy Physics, as in many other fields of science, the application of machine learning techniques has been crucial in advancing our understanding of fundamental phenomena. Increasingly, deep learning models are applied to analyze both simulated and experimental data. In most experiments, a rigorous regime of testing for physically motivated systematic uncertainties is in place. The numerical evaluation of these tests for differences between the data on the one side and simulations on the other side quantifies the effect of potential sources of mismodelling on the machine learning output. In addition, thorough comparisons of marginal distributions and (linear) feature correlations between data and simulation in "control regions" are applied. However, the guidance by physical motivation, and the need to constrain comparisons to specific regions, does not guarantee that all possible sources of deviations have been accounted for. We therefore propose a new adversarial attack - the CONSERVAttack - designed to exploit the remaining space of hypothetical deviations between simulation and data after the above mentioned tests. The resulting adversarial perturbations are consistent within the uncertainty bounds - evading standard validation checks - while successfully fooling the underlying model. We further propose strategies to mitigate such vulnerabilities and argue that robustness to adversarial effects must be considered when interpreting results from deep learning in particle physics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。