公开数据集看似开放，实则需数万元投入才能使用。
Accessibility Barriers in Multi-Terabyte Public Datasets: The Gap Between Promise and Practice
- 分析四大类超大数据库的使用门槛
- 实际分析需至少1000美元投入，复杂处理需1万至10万美元
- 适合关注数据公平性与科研资源分配的研究者
所谓‘免费开放’的多太字节数据集常面临现实障碍。尽管技术上可访问，但处理复杂度与隐性成本构成实用壁垒，使数据主要服务于资金充足的机构。本研究考察网页爬取、卫星影像、科学数据及协作项目中的可及性问题，揭示出理论开放背后存在系统性排他：标榜‘公开可访问’的数据集，通常需最低1000美元以上投入才能开展有意义分析，复杂处理流程更需1万至10万美元以上的基础设施投入。分布式计算知识、领域专长与充足预算成为使用门槛，即便数据开放，仍仅限有机构支持或雄厚资源者使用。
原文摘要 · Abstract (English)
The promise of "free and open" multi-terabyte datasets often collides with harsh realities. While these datasets may be technically accessible, practical barriers -- from processing complexity to hidden costs -- create a system that primarily serves well-funded institutions. This study examines accessibility challenges across web crawls, satellite imagery, scientific data, and collaborative projects, revealing a consistent two-tier system where theoretical openness masks practical exclusivity. Our analysis demonstrates that datasets marketed as "publicly accessible" typically require minimum investments of \$1,000+ for meaningful analysis, with complex processing pipelines demanding \$10,000-100,000+ in infrastructure costs. The infrastructure requirements -- distributed computing knowledge, domain expertise, and substantial budgets -- effectively gatekeep these datasets despite their "open" status, limiting practical accessibility to those with institutional support or substantial resources.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。