研究钓鱼网站检测中特征被攻击的成本与鲁棒性关系,发现模型复杂度不如特征经济重要。
Robustness, Cost, and Attack-Surface Concentration in Phishing Detection
- 构建成本感知的逃避框架,模拟攻击者在预算内修改特征的行为
- 80%以上成功攻击集中在3个低成本特征上,最小攻击成本中位数为2
- 模型鲁棒性由特征经济决定,而非模型复杂度,适合安全系统设计者阅读
基于人工特征的钓鱼网站检测器在独立同分布评估下准确率接近完美,但部署安全性依赖于对事后特征篡改的鲁棒性。本文通过一个考虑成本的规避框架,建模在明确攻击预算下的离散单调特征修改。提出三项诊断指标:最小规避成本(MEC)、规避生存率S(B)和鲁棒性集中指数(RCI)。在UCI钓鱼网站基准数据集(11,055个样本,30个三元特征)上,逻辑回归、随机森林、梯度提升树和XGBoost均达到AUC≥0.979。在预算约束的净化式规避下,不同模型的鲁棒性趋于一致:全特征下中位MEC为2,超过80%的最小成本规避集中在三个低代价特征上。仅当移除所有主导的低成本转换时,特征限制才能提升鲁棒性。在严格成本规则下,面向基础设施的特征集对集成模型有17-19%的不可行质量,而可规避实例的中位MEC保持不变。我们形式化证明:若正比例正确检测的钓鱼实例可通过单特征转移以最小成本c_min实现规避,则任何分类器都无法在不改变特征表示或成本模型的前提下,将对应MEC分位数提高至c_min以上。钓鱼检测的对抗鲁棒性由特征经济决定,而非模型复杂度。
原文摘要 · Abstract (English)
Phishing detectors built on engineered website features attain near-perfect accuracy under i.i.d.\ evaluation, yet deployment security depends on robustness to post-deployment feature manipulation. We study this gap through a cost-aware evasion framework that models discrete, monotone feature edits under explicit attacker budgets. Three diagnostics are introduced: minimal evasion cost (MEC), the evasion survival rate $S(B)$, and the robustness concentration index (RCI). On the UCI Phishing Websites benchmark (11\,055 instances, 30 ternary features), Logistic Regression, Random Forests, Gradient Boosted Trees, and XGBoost all achieve $\mathrm{AUC}\ge 0.979$ under static evaluation. Under budgeted sanitization-style evasion, robustness converges across architectures: the median MEC equals 2 with full features, and over 80\% of successful minimal-cost evasions concentrate on three low-cost surface features. Feature restriction improves robustness only when it removes all dominant low-cost transitions. Under strict cost schedules, infrastructure-leaning feature sets exhibit 17-19\% infeasible mass for ensemble models, while the median MEC among evadable instances remains unchanged. We formalize this convergence: if a positive fraction of correctly detected phishing instances admit evasion through a single feature transition of minimal cost $c_{\min}$, no classifier can raise the corresponding MEC quantile above $c_{\min}$ without modifying the feature representation or cost model. Adversarial robustness in phishing detection is governed by feature economics rather than model complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。