让AI主动提问并学习因果关系,实现持续协作决策。
SCOOP: A Framework for Proactive Collaboration and Social Continual Learning through Natural Language Interaction andCausal Reasoning
- 通过自然语言对话与因果推理,让AI主动提问以补全知识
- 在开放环境中实现知识积累与任务间成本分摊,提升适应性
- 适合研究社交学习、持续学习或智能助手的开发者
多模态信息获取场景中,用户与AI在动态环境中协作日益普遍。此类场景涉及文本与多模态交互,常需代价高昂的结构化请求。当前AI助手缺乏对用户真实目标、信念与偏好的访问能力,难以有效整合多元信息。本文提出一种社会持续学习框架,用于因果知识获取与协同决策。核心是自主代理通过对话、提问与互动,在开放且部分可观测环境中学习。引入自然语言代理回答关于环境机制与状态的查询,以优化探索与利用的平衡,逐步完善因果理解。评估任务借鉴发展心理学,强调因果推理与提问能力,补充基准测试,评估代理识别知识缺口、生成有意义问题及增量更新推理的能力。框架还评估知识获取成本在同环境任务间的分摊效果。提出两种架构:1)结合大语言模型(LLMs)与ReAct框架及问题生成;2)基于因果世界模型的高级系统,采用符号、图结构或子符号表示进行推理与决策,构建因果知识图以支持高效推理与约束下的适应性。挑战包括将因果推理融入ReAct,以及在易出错情境下优化探索与提问策略。该框架不仅具应用价值,还模拟了因果推理、提问生成与社会学习相结合的发展过程。
原文摘要 · Abstract (English)
Multimodal information-gathering settings, where users collaborate with AI in dynamic environments, are increasingly common. These involve complex processes with textual and multimodal interactions, often requiring additional structural information via cost-incurring requests. AI helpers lack access to users' true goals, beliefs, and preferences and struggle to integrate diverse information effectively. We propose a social continual learning framework for causal knowledge acquisition and collaborative decision-making. It focuses on autonomous agents learning through dialogues, question-asking, and interaction in open, partially observable environments. A key component is a natural language oracle that answers the agent's queries about environmental mechanisms and states, refining causal understanding while balancing exploration or learning, and exploitation or knowledge use. Evaluation tasks inspired by developmental psychology emphasize causal reasoning and question-asking skills. They complement benchmarks by assessing the agent's ability to identify knowledge gaps, generate meaningful queries, and incrementally update reasoning. The framework also evaluates how knowledge acquisition costs are amortized across tasks within the same environment. We propose two architectures: 1) a system combining Large Language Models (LLMs) with the ReAct framework and question-generation, and 2) an advanced system with a causal world model, symbolic, graph-based, or subsymbolic, for reasoning and decision-making. The latter builds a causal knowledge graph for efficient inference and adaptability under constraints. Challenges include integrating causal reasoning into ReAct and optimizing exploration and question-asking in error-prone scenarios. Beyond applications, this framework models developmental processes combining causal reasoning, question generation, and social learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。