arXiv:2501.13272cs.IRcs.CY2025-01

PCSI让网页转结构化数据的过程可共享可复现。

PCSI -- The Platform for Content-Structure Inference

  • 用Hex脚本解析HTML DOM,自动提取网页结构化信息
  • 记录方法与结果,支持同一类网址的批量处理
  • 适合需要规模化抓取网页内容的研究者和开发者

内容结构推断平台(PCSI,发音为'pixie')旨在促进将网络资源转换为符合预定义格式的结构化内容对象的过程信息共享。PCSI记录编码了从一类网址中推导结构化内容的方法,并报告特定方法应用于特定网址的结果。这些方法是用Hex编写的脚本,Hex是基于Awk的变体,具备遍历HTML DOM的特性。

原文摘要 · Abstract (English)

The Platform for Content-Structure Inference (PCSI, pronounced "pixie") facilitates the sharing of information about the process of converting Web resources into structured content objects that conform to a predefined format. PCSI records encode methods for deriving structured content from classes of URLs, and report the results of applying particular methods to particular URLs. The methods are scripts written in Hex, a variant of Awk with facilities for traversing the HTML DOM.

网页抽取结构化数据自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。