arXiv:2505.15042cs.DLcs.IR2025-05被引 2

GitHub 项目越复杂,网页和代码越难被网络档案馆保存。

GitHub Repository Complexity Leads to Diminished Web Archive Availability

  • 分析1.2万+个GitHub项目主页与源码树的存档情况。
  • 主页有31%轻微损坏,1.6%严重损坏;源码平均仅5%被存档。
  • 直接链接的文件存档率14.89%,深层目录几乎未被保存。

软件常通过Git等版本控制系统托管于GitHub、GitLab等中心化平台,以HTML网页形式呈现项目主页、目录及源文件。我们分析了超过12,000个主要来自GitHub的托管仓库主页,评估其展示内容在互联网档案馆(Internet Archive)中的保存情况,并考察了所收集仓库源码树的存档程度。结果显示,31%的已归档仓库主页存在轻微页面损坏,1.6%出现严重损坏。源码树方面,平均仅有不到5%的源文件被存档,多数仓库未保存任何源文件。存档集中度最高的是主页直接链接的文件,存档率达14.89%,但随着目录层级加深,存档率急剧下降。

原文摘要 · Abstract (English)

Software is often developed using versioned controlled software, such as Git, and hosted on centralized Web hosts, such as GitHub and GitLab. These Web hosted software repositories are made available to users in the form of traditional HTML Web pages for each source file and directory, as well as a presentational home page and various descriptive pages. We examined more than 12,000 Web hosted Git repository project home pages, primarily from GitHub, to measure how well their presentational components are preserved in the Internet Archive, as well as the source trees of the collected GitHub repositories to assess the extent to which their source code has been preserved. We found that more than 31% of the archived repository home pages examined exhibited some form of minor page damage and 1.6% exhibited major page damage. We also found that of the source trees analyzed, less than 5% of their source files were archived, on average, with the majority of repositories not having source files saved in the Internet Archive at all. The highest concentration of archived source files available were those linked directly from repositories' home pages at a rate of 14.89% across all available repositories and sharply dropping off at deeper levels of a repository's directory tree.

数字存档GitHub互联网档案馆代码保存

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。