分离推理与交互技能,让网页智能体持续学习更高效。
DRIVE: Modeling Skills at the Reasoning and Interaction Levels for Web Agents under Continual Learning

- 将任务逻辑和页面操作分层建模,解耦抽象与具体知识。
- 在五大数据集上平均成功率52.8%,比基线高7.3个百分点。
- 适合需要长期积累经验的自动化网页任务系统研发者。
网页智能体需兼具高层推理(任务分解)与底层交互(页面元素操作)能力。然而,这两类知识本质不同:推理知识(如订票需先查路线)抽象且跨网站可迁移,而交互知识(如在站点A特定坐标点击搜索按钮)高度依赖页面上下文。现有方法统一存储经验,导致抽象表示失去可执行性,具体表示难以泛化。这种纠缠限制了能力积累:在新网站上,智能体要么因表面差异无法识别可复用的任务逻辑,要么执行过时页面结构的动作。为此,我们提出DRIVE框架,将历史经验分为自然语言描述的推理技能(捕获可迁移的任务逻辑)和程序化交互技能(将抽象动作映射为可执行操作)。通过场景感知的协调机制,动态调用双层技能。此外,采用技能级反思识别特定层次的失败模式,支持针对性扩充与优化。在五个WebArena领域实验中,DRIVE平均任务成功率达52.8%,较无技能基线提升7.3个百分点。消融实验证明,推理与交互技能提供互补优势,验证了任务逻辑与页面操作分离的有效性。
原文摘要 · Abstract (English)
Web agents require both high-level reasoning (for task decomposition) and low-level interactions (for page elements manipulation) to conduct different tasks. However, these knowledge types differ fundamentally: reasoning knowledge (e.g., booking a flight requires first searching for routes) is abstract and transferable across websites, while interaction knowledge (e.g., clicking the Search button at a specific coordinate on Site A) depends heavily on page-specific contexts. Existing methods store experiences uniformly. This creates a dilemma: abstract representations lose executability on concrete pages, while concrete representations fail to generalize across domains. This entanglement limits capability accumulation: on new websites, agents either fail to recognize reusable task logic due to surface-level differences or attempt infeasible actions from outdated page structures. To disentangle them, we propose DRIVE, a dual-level skill modeling framework separating historical experience into natural language reasoning skills, which capture transferable task logic, and programmatic interaction skills, grounding abstract actions to executable operations. A scene-aware coordination mechanism adaptively retrieves and invokes these dual-level skills based on task semantics. DRIVE also uses skill-level reflection to identify hierarchy-specific failure modes, enabling targeted skill library expansion and refinement. Experiments across five WebArena domains show DRIVE attains an average task success rate of 52.8%, exceeding the skill-free baseline by 7.3 percentage points. Further ablations show reasoning and interaction skills provide distinct, complementary benefits, supporting separation of transferable task logic from executable page-level operations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。