arXiv:2509.24274cs.LGcs.AI2025-09

构建对抗强化学习框架,模拟会躲藏的作弊者与检测器的博弈。

Adversarial Reinforcement Learning Framework for ESP Cheater Simulation

  • 用强化学习建模作弊者和非作弊者,分不同可见性
  • 作弊者会根据被发现风险动态切换是否作弊
  • 适合研究自适应作弊行为与检测算法

超感官知觉(ESP)作弊会暴露隐藏的游戏信息(如敌人位置),但其影响难以从玩家行为中直接观测,导致难以获取可靠标注数据,制约反作弊系统训练。此外,作弊者常通过限制或伪装作弊行为来规避检测,进一步增加识别难度。为此,我们提出一个用于可控建模ESP作弊者、非作弊者及基于轨迹的检测器的仿真框架。将作弊者与非作弊者建模为可观测性不同的强化学习智能体,检测器则对行为轨迹进行分类。我们将作弊者与检测器的交互建模为对抗博弈,使双方可协同演化。为反映真实作弊策略,引入结构化作弊模型,根据检测风险动态切换作弊与非作弊状态。实验表明,该框架能有效模拟出在收益优化与逃避检测之间权衡的自适应作弊行为。本工作提供了一个可控且可扩展的平台,可用于研究自适应作弊行为并开发高效检测方法。

原文摘要 · Abstract (English)

Extra-Sensory Perception (ESP) cheats, which reveal hidden in-game information such as enemy locations, are difficult to detect because their effects are not directly observable in player behavior. The lack of observable evidence makes it difficult to collect reliably labeled data, which is essential for training effective anti-cheat systems. Furthermore, cheaters often adapt their behavior by limiting or disguising their cheat usage, which further complicates detection and detector development. To address these challenges, we propose a simulation framework for controlled modeling of ESP cheaters, non-cheaters, and trajectory-based detectors. We model cheaters and non-cheaters as reinforcement learning agents with different levels of observability, while detectors classify their behavioral trajectories. Next, we formulate the interaction between the cheater and the detector as an adversarial game, allowing both players to co-adapt over time. To reflect realistic cheater strategies, we introduce a structured cheater model that dynamically switches between cheating and non-cheating behaviors based on detection risk. Experiments demonstrate that our framework successfully simulates adaptive cheater behaviors that strategically balance reward optimization and detection evasion. This work provides a controllable and extensible platform for studying adaptive cheating behaviors and developing effective cheat detectors.

反作弊强化学习对抗训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。