arXiv:2601.09543cs.IR2026-01

研究发现网页分割中用DOM坐标比视觉坐标更准,简单坐标向量效果更好。

Examining DOM Coordinate Effectiveness For Page Segmentation

  • 用DOM坐标构建分割向量,比视觉坐标平均高20%-30%准确率。
  • 68.2%表现最好的向量仅由单一坐标构成,复杂向量效果差。
  • 匹配合适向量与算法后,分割准确率达74%,提升20%。

网页是日常信息的重要来源,随着基于大语言模型的搜索与学习系统兴起,其数据价值日益凸显。然而,数据规模持续增长且格式不统一,亟需高效自动化提取与检索机制。现有方法常依赖网页文档对象模型(DOM)中的坐标信息(如视觉位置或树结构)生成聚类向量,但这些向量的构建方式与有效性未被充分检验。本文深入分析了DOM坐标的适用性,发现不存在通用最优向量;视觉坐标在平均上比DOM坐标低20%-30%。此外,仅由单一坐标构成的简单向量在所检页面中占到68.2%的顶尖表现,优于复杂组合。当向量、聚类算法与页面特性匹配良好时,可实现74%的高分割准确率,相较盲目使用向量提升20%。结果挑战了当前主流的向量设计范式,表明通过优化基于DOM坐标的聚类策略,有望显著提升网页分割性能,并强调适配匹配机制的重要性。

原文摘要 · Abstract (English)

Web pages form a cornerstone of available data for daily human consumption and with the rise of LLM-based search and learning systems a treasure trove of valuable data. The scale of this data and its unstructured format still continue to grow requiring ever more robust automated extraction and retrieval mechanisms. Existing work, leveraging the web pages Document Object Model (DOM), often derives clustering vectors from coordinates informed by the DOM such as visual placement or tree structure. The construction and component value of these vectors often go unexamined. Our work proposes and examines DOM coordinates in a detail to understand their impact on web page segmentation. Our work finds that there is no one-size-fits-all vector, and that visual coordinates under-perform compared to DOM coordinates by about 20-30% on average. This challenges the necessity of including visual coordinates in clustering vectors. Further, our work finds that simple vectors, comprised of single coordinates, fare better than complex vectors constituting 68.2% of the top performing vectors of the pages examined. Finally, we find that if a vector, clustering algorithm, and page are properly matched, one can achieve overall high segmentation accuracy at 74%. This constitutes a 20% improvement over a naive application of vectors. Conclusively, our results challenge the current orthodoxy for segmentation vector creation, opens up the possibility to optimize page segmentation via clustering on DOM coordinates, and highlights the importance of finding mechanisms to match the best approach for web page segmentation.

网页分割DOM坐标聚类优化数据提取

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。