arXiv:2508.01858cs.CLcs.AI2025-08中稿 · ICLR被引 2

让网页智能体像人一样思考:先学知识,再推理行动。

Web-CogReasoner: Towards Multimodal Knowledge-Induced Cognitive Reasoning for Web Agents

  • 分三类知识(事实/概念/流程)构建认知框架,指导智能体学习与推理
  • 在未见过的任务上表现显著优于现有模型,结构化知识是关键优势
  • 开源数据集与评测基准,适合研究智能体认知与跨任务泛化者

多模态大模型推动了网页智能体的发展,使其具备类似人类的认知感知与交互能力。本文认为,智能体必须先掌握充分知识才能有效进行认知推理。因此,将智能体能力分解为知识获取与认知过程两个阶段。提出 Web-CogKnowledge 框架,将知识分为事实型、概念型和流程型。知识获取对应记忆与理解,依赖前两类知识,体现‘是什么’;认知过程对应探索,基于流程型知识,定义‘怎么做’。为此构建 Web-CogDataset,从14个真实网站收集结构化数据,作为智能体的认知基础。在此基础上,设计知识驱动的链式思维(CoT)推理框架,训练出 Web-CogReasoner 智能体。实验表明其在未见任务上的泛化能力显著领先于现有模型。同时推出 Web-CogBench 评测基准,系统评估不同知识领域与认知能力的表现。代码与数据已开源。

原文摘要 · Abstract (English)

Multimodal large-scale models have significantly advanced the development of web agents, enabling perception and interaction with digital environments akin to human cognition. In this paper, we argue that web agents must first acquire sufficient knowledge to effectively engage in cognitive reasoning. Therefore, we decompose a web agent's capabilities into two essential stages: knowledge content learning and cognitive processes. To formalize this, we propose Web-CogKnowledge Framework, categorizing knowledge as Factual, Conceptual, and Procedural. In this framework, knowledge content learning corresponds to the agent's processes of Memorizing and Understanding, which rely on the first two knowledge types, representing the "what" of learning. Conversely, cognitive processes correspond to Exploring, grounded in Procedural knowledge, defining the "how" of reasoning and action. To facilitate knowledge acquisition, we construct the Web-CogDataset, a structured resource curated from 14 real-world websites, designed to systematically instill core knowledge necessary for web agent. This dataset serves as the agent's conceptual grounding-the "nouns" upon which comprehension is built-as well as the basis for learning how to reason and act. Building on this foundation, we operationalize these processes through a novel knowledge-driven Chain-of-Thought (CoT) reasoning framework, developing and training our proposed agent, the Web-CogReasoner. Extensive experimentation reveals its significant superiority over existing models, especially in generalizing to unseen tasks where structured knowledge is decisive. To enable rigorous evaluation, we introduce the Web-CogBench, a comprehensive evaluation suite designed to assess and compare agent performance across the delineated knowledge domains and cognitive capabilities. Our code and data is open sourced at https://github.com/Gnonymous/Web-CogReasoner

智能体认知推理知识图谱链式思维

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。