arXiv:2507.22019cs.DLcs.IR2025-07中稿 · the 2025 ACM Web S…被引 5

分析1100万网页重定向,揭示网站迁移与错误链的常见模式。

Not Here, Go There: Analyzing Redirection Patterns on the Web

  • 追踪每条链接最多10跳,发现50%重定向成功,50%失败。
  • 0.06%链接跳转超过10次,6.2万自定义404页面近半为软错误。
  • 识别出'汇聚点'链接,用于流量集中或恶意诱导如瑞克摇。

URI重定向是网络管理的核心机制,支持结构变更、SEO优化和安全防护。然而其复杂性影响可用性、搜索引擎表现及数字保存。本研究分析了1100万唯一重定向URI,每条最多追踪10跳,揭示重定向实践的模式与影响。结果显示,50%的链接成功终止,50%出现错误,其中0.06%超过10跳。标准重定向(如HTTP转HTTPS)普遍,符合SEO最佳实践;非标准重定向(涉及域名或路径变化)则反映重大网站迁移、品牌重塑及安全风险。识别出6.2万个自定义404页面,近半为软404,可能损害SEO与用户体验。研究揭示了重定向在塑造网络中的关键作用,也暴露了过时链接、服务器不稳定与错误处理不当等问题。通过大规模数据分析,揭示重定向链效率低下与'汇聚点'等模式,为网站管理员、研究人员及数字档案工作者提供优化建议。

原文摘要 · Abstract (English)

URI redirections are integral to web management, supporting structural changes, SEO optimization, and security. However, their complexities affect usability, SEO performance, and digital preservation. This study analyzed 11 million unique redirecting URIs, following redirections up to 10 hops per URI, to uncover patterns and implications of redirection practices. Our findings revealed that 50% of the URIs terminated successfully, while 50% resulted in errors, including 0.06% exceeding 10 hops. Canonical redirects, such as HTTP to HTTPS transitions, were prevalent, reflecting adherence to SEO best practices. Non-canonical redirects, often involving domain or path changes, highlighted significant web migrations, rebranding, and security risks. Notable patterns included "sink" URIs, where multiple redirects converged, ranging from traffic consolidation by global websites to deliberate "Rickrolling." The study also identified 62,000 custom 404 URIs, almost half being soft 404s, which could compromise SEO and user experience. These findings underscore the critical role of URI redirects in shaping the web while exposing challenges such as outdated URIs, server instability, and improper error handling. This research offers a detailed analysis of URI redirection practices, providing insights into their prevalence, types, and outcomes. By examining a large dataset, we highlight inefficiencies in redirection chains and examine patterns such as the use of "sink" URIs and custom error pages. This information can help webmasters, researchers, and digital archivists improve web usability, optimize resource allocation, and safeguard valuable online content.

网页重定向数据挖掘SEO优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。