arXiv:2506.05252cs.LGcs.GT2025-06NeurIPS被引 3

研究智能体主动改进后,分类器如何更稳定地学习并降低误差。

Conservative classifiers do consistently well with improving agents: characterizing statistical and online learning

  • 提出非对称一致概念类,精确刻画可实现情形下的有效学习机制。
  • 在欧氏球形改进区域内,证明了非正则学习的可行性与更低泛化误差。
  • 解决前人未解问题,适用于真实场景中自适应行为的学习者。

机器学习已广泛应用于社会决策,如求职或贷款审批,需考虑被分类主体对算法的反应。现有策略分类研究多关注遏制欺骗行为,但近期工作发现:当主体真实提升以获得理想分类时,泛化误差反而可能低于标准PAC学习。本文从多个新维度刻画“带改进的学习性”。引入非对称最小一致概念类,在可实现设定下精确表征正则学习。不同于以往任意改进区域的研究,本文在更自然的欧氏球形改进集下取得正向结果,尤其在数据分布满足温和生成假设时,实现了非正则学习。进一步,在经典有界噪声模型下获得更低泛化误差,并在可实现与广义在线学习中给出误判次数上界。解决了Attias等提出的关于正则与非正则学习的开放问题。

原文摘要 · Abstract (English)

Machine learning is now ubiquitous in societal decision-making, for example in evaluating job candidates or loan applications, and it is increasingly important to take into account how classified agents will react to the learning algorithms. The majority of recent literature on strategic classification has focused on reducing and countering deceptive behaviors by the classified agents, but recent work of Attias et al. identifies surprising properties of learnability when the agents genuinely improve in order to attain the desirable classification, such as smaller generalization error than standard PAC-learning. In this paper we characterize so-called learnability with improvements across multiple new axes. We introduce an asymmetric variant of minimally consistent concept classes and use it to provide an exact characterization of proper learning with improvements in the realizable setting. While prior work studies learnability only under general, arbitrary agent improvement regions, we give positive results for more natural Euclidean ball improvement sets. In particular, we characterize improper learning under a mild generative assumption on the data distribution. We further show how to learn in more challenging settings, achieving lower generalization error under well-studied bounded noise models and obtaining mistake bounds in realizable and agnostic online learning. We resolve open questions posed by Attias et al. for both proper and improper learning.

机器学习策略分类在线学习泛化误差

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。