arXiv:2608.18727cs.LGcs.IR2026-08

构建可还原网页视觉布局的机器学习平台,支持内容识别与实验复现。

Visual-Aware Representation of Web Pages for Machine Learning Applications

  • 基于FitLayout渲染网页,用RDF记录视觉与结构信息
  • 通过图神经网络识别关键内容元素,准确率提升显著
  • 适合网页理解、自动化标注与可复现研究的团队使用

将机器学习应用于网页面临挑战:需解析HTML及关联资源,并通过渲染获取有意义的视觉和布局感知表示。为此,本文提出一个基于开源渲染工具FitLayout的可视化网页表示平台。该平台提供服务器,可渲染网页,以基于RDF的格式显式捕获其视觉与结构特性,并在集成存储中持久化文档。处理流程通过REST API控制,使用SPARQL查询提取适合作为机器学习输入的结构化数据。通过显式建模已渲染网页(包括细粒度布局细节),平台支持数据集共享,保障实验结果可复现。架构涵盖从网页采集、渲染、预处理与元素标注到下游学习任务的完整工作流。我们还提供了整合平台的Python客户端库。以示例说明:可将渲染后的网页转化为基于图的表示,并用于训练图神经网络识别关键内容元素,验证了方法的有效性与结果的可复现性。

原文摘要 · Abstract (English)

Applying machine learning to web pages is challenging due to the need to interpret HTML together with associated resources and perform rendering to obtain a meaningful visual and layout-aware representation. As a result, machine learning over web content remains comparatively underexplored. In this paper, we present a platform for visual-aware representation and machine learning over web pages based on the open-source rendering tool FitLayout. The platform provides a server capable of rendering web pages, explicitly capturing their visual and structural properties in an RDF-based representation, and persisting the rendered documents in an integrated storage. The processing pipeline is controlled via a REST API, while SPARQL queries are used to retrieve structured data suitable as input for machine learning algorithms. By explicitly modeling rendered web pages, including fine-grained layout details, the platform enables dataset sharing and supports the reproducibility of experimental results. The architecture supports the complete dataset preparation workflow, from web page collection and rendering through preprocessing and annotation of content elements to downstream learning tasks. We further provide a Python client library that integrates the platform with standard machine learning workflows. As a demonstration, we show how rendered web pages can be transformed into graph-based representations and used to train graph neural networks for recognizing key content elements, illustrating both the applicability of the approach and the reproducibility of the results.

网页理解图神经网络可复现性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。