设计可校准的损失函数,让模型在对抗攻击下学会合理拒绝预测。
Towards Calibrated Losses for Adversarial Robust Reject Option Classification
- 提出新型对抗鲁棒拒判损失ℓₐᵞ,适配线性分类器
- 证明凸型与拟凹型损失无法满足校准条件
- 实验证明修正版双阶梯和双指数损失具鲁棒性
在自动驾驶、医疗诊断等高风险场景中,模型对对抗攻击的鲁棒性至关重要。当误判代价极高时,判断何时拒绝预测尤为关键。本文旨在刻画并设计适用于‘对抗鲁棒拒判’设置的校准代理损失。首先,提出对抗鲁棒拒判损失ℓₐᵞ,并在线性分类器(ℋ_lin)上进行分析;其次,给出任意代理损失在ℓₐᵞ与ℋ_lin下实现校准的完整刻画结果。为展示设计校准代理的困难,证明凸代理损失及拟凹条件风险情形在该设置下不具校准性(而此前在无拒判对抗设置中曾表现良好)。同时通过实验论证修正版双阶梯损失(DRL)与双指数损失(DSL)满足校准条件。最后,在合成数据集上验证修正DRL与DSL对对抗扰动的鲁棒性。
原文摘要 · Abstract (English)
Robustness towards adversarial attacks is a vital property for classifiers in several applications such as autonomous driving, medical diagnosis, etc. Also, in such scenarios, where the cost of misclassification is very high, knowing when to abstain from prediction becomes crucial. A natural question is which surrogates can be used to ensure learning in scenarios where the input points are adversarially perturbed and the classifier can abstain from prediction? This paper aims to characterize and design surrogates calibrated in "Adversarial Robust Reject Option" setting. First, we propose an adversarial robust reject option loss $\ell_{d}^γ$ and analyze it for the hypothesis set of linear classifiers ($\mathcal{H}_{\textrm{lin}}$). Next, we provide a complete characterization result for any surrogate to be $(\ell_{d}^γ,\mathcal{H}_{\textrm{lin}})$- calibrated. To demonstrate the difficulty in designing surrogates to $\ell_{d}^γ$, we show negative calibration results for convex surrogates and quasi-concave conditional risk cases (these gave positive calibration in adversarial setting without reject option). We also empirically argue that Shifted Double Ramp Loss (DRL) and Shifted Double Sigmoid Loss (DSL) satisfy the calibration conditions. Finally, we demonstrate the robustness of shifted DRL and shifted DSL against adversarial perturbations on a synthetically generated dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。