arXiv:2510.24459cs.AIcs.MA2025-10被引 3

让智能代理高效理解网页并动态发现服务功能

Affordance Representation and Recognition for Autonomous Agents

  • 将复杂网页结构转化为精简任务相关表示
  • 运行时解析服务描述,自动识别新功能
  • 提升代理在多变网络环境下的适应能力

软件代理的自主性依赖于从数字环境的结构化数据(如网页的文档对象模型DOM和网络服务的语义描述)中构建可操作的内部世界模型。然而,直接使用原始结构化数据面临两大挑战:冗长的HTML使基础模型难以处理,而硬编码的API集成无法适应不断变化的服务。本文提出一种用于结构化数据世界建模的模式语言,包含两种互补架构模式。DOM转换模式通过将冗长的原始DOM提炼为紧凑、任务相关的表示,解决网页复杂性问题;超媒体可用性识别模式则使代理能解析标准化的语义描述,在运行时发现并集成未知网络服务的功能。二者共同构建了一个稳健框架,支持代理高效构建与维护精确的世界模型,实现跨网络及其扩展资源的可扩展、自适应与互操作自动化。

原文摘要 · Abstract (English)

The autonomy of software agents is fundamentally dependent on their ability to construct an actionable internal world model from the structured data that defines their digital environment, such as the Document Object Model (DOM) of web pages and the semantic descriptions of web services. However, constructing this world model from raw structured data presents two critical challenges: the verbosity of raw HTML makes it computationally intractable for direct use by foundation models, while the static nature of hardcoded API integrations prevents agents from adapting to evolving services. This paper introduces a pattern language for world modeling from structured data, presenting two complementary architectural patterns. The DOM Transduction Pattern addresses the challenge of web page complexity by distilling} a verbose, raw DOM into a compact, task-relevant representation or world model optimized for an agent's reasoning core. Concurrently, the Hypermedia Affordances Recognition Pattern enables the agent to dynamically enrich its world model by parsing standardized semantic descriptions to discover and integrate the capabilities of unknown web services at runtime. Together, these patterns provide a robust framework for engineering agents that can efficiently construct and maintain an accurate world model, enabling scalable, adaptive, and interoperable automation across the web and its extended resources.

世界建模智能代理网页理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。