arXiv:2602.18588cs.IRcs.DB2026-02

让实验数据从起步就可共享,无需复杂架构。

Altar: Structuring Sharable Experimental Data from Early Exploration to Publication

  • 用灵活的NoSQL数据库记录参数、元数据和小文件
  • 大原始数据独立存储并用唯一标识关联,保证可追溯性
  • 适合不同角色科研人员,易集成现有工作流

实验项目开发阶段的数据与元数据管理面临重大挑战,尤其在协作研究中。这一阶段常被项目提案中的数据管理计划忽视,但对可复现性和避免发表时回溯重建至关重要。本文提出Altar,一个轻量级、领域无关的框架,自项目初期即结构化实验数据,不强制固定数据模型。Altar基于Sacred实验追踪机制,捕获实验(元)数据并进行组织:参数、元数据、曲线和小文件存入灵活的NoSQL数据库,大原始数据则保存在专用存储中并通过唯一标识链接,确保高效与可追溯。该集成可与现有工作流组合,对日常习惯干扰极小。我们根据用户技能(博士生、博士后、首席研究员、实验室管理员、系统管理员)提供了多种使用路径。初始使用无需特殊基础设施,随规模扩大或发布前可轻松部署于服务器并公开访问。Altar通过解决研究动态阶段的问题,为探索性实验与符合FAIR原则的数据共享之间搭建了实用桥梁。

原文摘要 · Abstract (English)

Managing the data and metadata during the active development phase of an experimental project presents a significant challenge, particularly in collaborative research. This phase is frequently overlooked in Data Management Plans included in project proposals, despite its important role in ensuring reproducibility and preventing the need for retroactive reconstruction at the time of publication. Here we present Altar, a lightweight, domain-agnostic framework for structuring experimental data from the onset of a project without imposing rigid data models. Altar is built around the Sacred experiment-tracking model and captures experimental (meta)data and structures them. Parameters, metadata, curves and small files are stored in a flexible NoSQL database, while large raw data are maintained in dedicated storage and linked through unique identifiers, ensuring efficiency and traceability. This integration is composable with exiting workflows, allowing integration with minimial disruption of work habits. We document different pathways to use Altar based on users skillset (PhD students, Post-docs, Principal Investigators, Laboratory administrators, System administrators). While getting started with Altar does not require a specialized infrastructure, the framework can be easily deployed on a server and made publicly accessible when scaling up or preparing data for publication. By addressing the dynamic phase of research, Altar provides a practical bridge between exploratory experimentation and FAIR-aligned data sharing.

实验管理数据共享FAIR轻量框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。