让智能体学会解释自己为何成功,用问题和测试自动优化行为机制。
Learning Explicit Behavioral Models with Adaptive Questions and World-Model Probes

- 用符号规则和机制记忆构建可解释的行为模型,支持问答与预测。
- 在Atari风格环境中实现高分策略,同时生成可执行的机制解释。
- 适合关注可解释性、智能体调试与动态适应的研究者。
仅基于任务回报训练的交互智能体虽能取得高分,却难以表征其成功背后的机制,导致行为脆弱且难以诊断,环境变化时难以适应。现有大模型反思与策略修复方法可在失败轨迹后修正行为,但问题与世界理解测试通常仅在训练后使用。本文提出可训练的显式符号行为模型(ESBM),将任务表现与基于证据的问题回答及可执行机制预测耦合。ESBM通过带类型的谓词、加权规则、有限选项和机制记忆表征行为;其机制层可预测动作干预下的符号事件、物体变化、奖励及终止后果。每次滚动后,自适应问题与主动世界模型探针将得分失败、问答错误和转移预测误差转化为局部ESBM编辑的约束条件。候选模型由多准则规则选择,综合评估任务得分、回答能力与主动世界模型一致性。在测试的Atari风格协议下,ESBM既学习到高分策略,又能生成明确答案和可执行的机制预测,表明自适应问题可作为训练压力与可复用的机制学习基准。
原文摘要 · Abstract (English)
Interactive agents trained only against task return can achieve high scores while failing to represent the mechanisms that make their actions succeed. This makes brittle behavior difficult to diagnose and limits adaptation when environment dynamics change. Existing LLM reflection and policy-code repair can revise behavior from failed trajectories, but questions and world-understanding tests are usually used only after training. We introduce an Explicit Symbolic Behavioral Model (ESBM), a trainable behavioral model that couples task performance with evidence-grounded question answering and executable mechanism prediction. An ESBM represents behavior through typed predicates, weighted rules, bounded options and mechanism memory; the mechanism layer predicts symbolic events, object changes, rewards and terminal consequences under action interventions. After each rollout, adaptive questions and active world-model probes convert score failures, QA errors and transition-prediction errors into constraints for local ESBM edits. Candidate models are selected by a multi-criterion rule that jointly evaluates task score, answerability and active world-model consistency. Under the tested Atari-style protocols, ESBM learns high-scoring policies while producing explicit answers and executable mechanism predictions, indicating that adaptive questions can serve as both training pressure and reusable benchmarks for mechanistic policy learning in this setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。