提出新方法在测试时检测目标检测模型的后门样本
Test-Time Backdoor Detection for Object Detection Models
- 通过变换图像前景背景,分析检测置信度一致性来识别中毒样本
- 在多个数据集上实现比现有方法高30%的检测准确率(AUROC)
- 无需模型内部信息,适用于多种攻击类型,适合安全检测场景
目标检测模型易受后门攻击,攻击者通过在少量训练样本中嵌入预定义触发器,操控模型预测。在测试阶段检测含触发器的中毒样本可防止后门激活。然而,与图像分类不同,目标检测输出大量物体,其独特特性带来了新挑战;复杂攻击效果(如“幽灵”物体出现或“消失”物体)使现有防御手段基本失效。为此,我们提出TRAnsformation Consistency Evaluation(TRACE),一种全新的测试时中毒样本检测方法。研究发现:(1)中毒样本在不同背景下的检测结果一致性显著高于正常样本;(2)正常样本在引入不同焦点信息时表现出更高的一致性。基于此,TRACE对每个测试样本施加前景与背景变换,通过计算物体置信度方差评估变换一致性。该方法实现黑盒、通用后门检测,在广泛实验中相较当前最优防御提升30% AUROC,且能抵御自适应攻击。
原文摘要 · Abstract (English)
Object detection models are vulnerable to backdoor attacks, where attackers poison a small subset of training samples by embedding a predefined trigger to manipulate prediction. Detecting poisoned samples (i.e., those containing triggers) at test time can prevent backdoor activation. However, unlike image classification tasks, the unique characteristics of object detection -- particularly its output of numerous objects -- pose fresh challenges for backdoor detection. The complex attack effects (e.g., "ghost" object emergence or "vanishing" object) further render current defenses fundamentally inadequate. To this end, we design TRAnsformation Consistency Evaluation (TRACE), a brand-new method for detecting poisoned samples at test time in object detection. Our journey begins with two intriguing observations: (1) poisoned samples exhibit significantly more consistent detection results than clean ones across varied backgrounds. (2) clean samples show higher detection consistency when introduced to different focal information. Based on these phenomena, TRACE applies foreground and background transformations to each test sample, then assesses transformation consistency by calculating the variance in objects confidences. TRACE achieves black-box, universal backdoor detection, with extensive experiments showing a 30% improvement in AUROC over state-of-the-art defenses and resistance to adaptive attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。