提出新方法决定模型该保留什么表示,提升长期学习与迁移能力。
What Is Worth Representing? Representational Empowerment for Continual Model Construction

- 用表示赋能衡量候选元素对未来建模能力的提升
- 在因果学习和规划任务中,显著提升结构恢复与跨任务泛化
- 适合研究持续学习、智能体建模与符号知识构建的学者
建模世界的首要问题并非参数或因果结构估计,而是判断何物值得表示。本文将此问题定义为持续模型构建:智能体维护一个不可见世界W的环境特异性模型M,并建立可复用的持久表示元素库L。提出表示赋能(RepEmp)机制,通过评估候选元素对智能体未来建模与规划能力的扩展程度来打分,是对经典赋能概念的重构——从对外部状态的控制转为对内部表示的控制。通过层级式策展者-行动者架构实现,三组实验验证:在封闭词汇因果学习任务中,人类参与者更关注目标可达性而非世界忠实度,这一行为被RepEmp优于信息增益模型所预测;匹配模拟显示,由RepEmp引导的构建比探索更有效促进结构恢复与跨任务迁移;在开放词汇规划域中,大语言模型增强的策展者构建出更紧凑的符号库,且泛化能力更强,移除RepEmp则损失全部优势。结果表明,RepEmp是持续模型构建的核心原则:在资源受限下,决定该建、存、用什么。
原文摘要 · Abstract (English)
The first problem of modeling the world is not just estimating the right parameters or causal structure, but deciding what should be represented at all. We frame this problem as continual model construction: an agent maintains an environment-specific model M of an inaccessible world W and curates a persistent library L of reusable representational elements across environments. We propose Representational Empowerment (RepEmp) to score candidate elements by how much they expand the agent's future capacity to model and plan, complementing the classic definition of empowerment, but redefined as control over internal representations instead of external states. We realize the framework as a hierarchical Curator-Actor architecture and test it across three experiments. In a closed-vocabulary causal-learning task, human participants construct causal models at varying abstraction granularities to maximize goal reachability rather than fidelity to the world, a signature better predicted by RepEmp than by information-gain alternatives. Matched simulations reveal that RepEmp-guided construction contributes more than exploration to sufficient structure recovery and cross-task transfer. Finally, in an open-vocabulary planning domain, an LLM-augmented Curator builds more compact symbolic libraries, which also generalize better than baselines. Ablating RepEmp eliminates these benefits. Together, these results identify RepEmp as a key principle for continual model construction: deciding what to build, retain, and reuse under bounded resources.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。