让分类器有不判断的权利,能有效遏制作弊行为并提升准确率。
When In Doubt, Abstain: The Impact of Abstention on Strategic Classification
- 设计分级博弈模型,让分类器先公布策略,再应对用户伪装特征。
- 引入拒绝决策后,分类器损失不恶化,且误判率显著下降。
- 对能力弱的用户形成威慑,使其篡改成本过高而放弃操纵。
算法决策日益普遍,但常被试图获得有利结果的个体策略性操纵。已有研究显示,分类器通过拒绝低置信度判断(即允许不作决定)可显著提升准确性。本文在策略分类框架下研究这一机制,探讨其对策略性行为的影响及最优运用方式。建模为斯塔克尔伯格博弈:主方(分类器)先行公布决策策略,从方(策略性代理)随后调整可观测特征以获取理想结果。针对二值分类问题,我们证明最优拒绝策略下,主方效用(或损失)不会劣于非拒绝情形,即使存在策略性行为。此外,拒绝不仅提升精度,还能抑制操纵——当操纵成本足够高时,低资质代理因成本过高而放弃篡改。结果表明,拒绝是缓解算法系统中策略性行为负面影响的重要工具。
原文摘要 · Abstract (English)
Algorithmic decision making is increasingly prevalent, but often vulnerable to strategic manipulation by agents seeking a favorable outcome. Prior research has shown that classifier abstention (allowing a classifier to decline making a decision due to insufficient confidence) can significantly increase classifier accuracy. This paper studies abstention within a strategic classification context, exploring how its introduction impacts strategic agents' responses and how principals should optimally leverage it. We model this interaction as a Stackelberg game where a principal, acting as the classifier, first announces its decision policy, and then strategic agents, acting as followers, manipulate their features to receive a desired outcome. Here, we focus on binary classifiers where agents manipulate observable features rather than their true features, and show that optimal abstention ensures that the principal's utility (or loss) is no worse than in a non-abstention setting, even in the presence of strategic agents. We also show that beyond improving accuracy, abstention can also serve as a deterrent to manipulation, making it costlier for agents, especially those less qualified, to manipulate to achieve a positive outcome when manipulation costs are significant enough to affect agent behavior. These results highlight abstention as a valuable tool for reducing the negative effects of strategic behavior in algorithmic decision making systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。