升级人类评估数据表,提升清晰度与填写一致性。
HEDS 3.0: The Human Evaluation Data Sheet Version 3.0
- 基于真实实验反馈优化数据表结构
- 支持导出为LaTeX格式,便于论文撰写
- 适合需要规范评估流程的研究者使用
本文介绍了人类评估数据表(HEDS)的3.0版本。该更新基于我们在多项近期人类评估实验(包括复现研究)中使用HEDS的经验,以及收到的用户反馈。主要目标是提升清晰度,并帮助用户更一致、可比地完成数据表。HEDS 3.0包含数字版数据表、文档说明,以及将填写后的数据表导出为LaTeX文件的代码,均发布于HEDS GitHub仓库。
原文摘要 · Abstract (English)
This paper presents version 3.0 of the Human Evaluation Datasheet (HEDS). This update is the result of our experience using HEDS in the context of numerous recent human evaluation experiments, including reproduction studies, and of feedback received. Our main overall goal was to improve clarity, and to enable users to complete the datasheet more consistently and comparably. The HEDS 3.0 package consists of the digital data sheet, documentation, and code for exporting completed data sheets as latex files, all available from the HEDS GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。