arXiv:2506.14582cs.CRcs.CV2025-06被引 2

机器学习投票系统存漏洞,伪造选票可影响选举结果

Busting the Paper Ballot: Voting Meets Adversarial Machine Learning

  • 构建新选票数据集,测试多种模型在识别选票标记时的抗攻击能力
  • 发现传统对抗攻击无效,因数值不稳导致梯度屏蔽,但新方法可突破
  • 实验证明物理打印对抗选票仅5%成功率就可能改写选举结果,适合安全研究者

我们揭示了在美国选举计票系统中使用机器学习分类器所面临的安 全风险。选举计票的核心任务是判断选票上某个选项的圆圈内是否存在标记。Barretto 等人(E-Vote-ID 2021)报告称卷积神经网络在此领域表现优于传统特征分类器。本文贡献分为四部分:首先,我们引入四个新的选票数据集;其次,在这些数据集上训练并测试多种模型,包括支持向量机、基础CNN、VGG、ResNet以及视觉变压器(Twins和CaiT);第三,我们发现由于梯度屏蔽,传统白盒攻击在投票场景中无效,而该现象源于数值不稳定性,并采用改进的对数几率比损失(Croce and Hein, ICML 2020)克服此问题;第四,在物理世界中,我们使用新方法生成的对抗样本进行实际攻击。在传统对抗机器学习中,50%以上的攻击成功率理想,但在某些选举中,即使5%的成功率也能改变竞选结果。我们证明这一影响在物理层面是可能的,并深入讨论了对抗选票打印与扫描的现实性、挑战与可行性。

原文摘要 · Abstract (English)

We show the security risk associated with using machine learning classifiers in United States election tabulators. The central classification task in election tabulation is deciding whether a mark does or does not appear on a bubble associated to an alternative in a contest on the ballot. Barretto et al. (E-Vote-ID 2021) reported that convolutional neural networks are a viable option in this field, as they outperform simple feature-based classifiers. Our contributions to election security can be divided into four parts. To demonstrate and analyze the hypothetical vulnerability of machine learning models on election tabulators, we first introduce four new ballot datasets. Second, we train and test a variety of different models on our new datasets. These models include support vector machines, convolutional neural networks (a basic CNN, VGG and ResNet), and vision transformers (Twins and CaiT). Third, using our new datasets and trained models, we demonstrate that traditional white box attacks are ineffective in the voting domain due to gradient masking. Our analyses further reveal that gradient masking is a product of numerical instability. We use a modified difference of logits ratio loss to overcome this issue (Croce and Hein, ICML 2020). Fourth, in the physical world, we conduct attacks with the adversarial examples generated using our new methods. In traditional adversarial machine learning, a high (50% or greater) attack success rate is ideal. However, for certain elections, even a 5% attack success rate can flip the outcome of a race. We show such an impact is possible in the physical domain. We thoroughly discuss attack realism, and the challenges and practicality associated with printing and scanning ballot adversarial examples.

机器学习安全对抗攻击选举系统视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。