构建多维度事实性标注体系，用于议会辩论文本的事实核查。
An Annotation Scheme for Factuality and its Application to Parliamentary Proceedings
- 设计融合多种语言信号的复杂标注框架，支持多角度事实判断。
- 人工标注近5000条议会话语，建立高质量事实性语料库。
- 提供可迁移的标注方案，适合研究事实核查与自然语言理解者使用。
事实性评估语言表述与现实信息之间的关联程度，判断其是否对应真实、可能或虚构情境，对事实核查至关重要。该概念复杂，依赖多种语言线索，已有跨学科研究基础。本文提出一种融合多种前期成果的多维度事实性标注方案，专为希伯来语设计，但具备跨语言适应潜力。我们基于该方案对近5000个议会辩论句子进行了人工标注，并报告了标注者间一致性结果。同时，针对该标注体系的部分特征，实验了多种自动预测方法，以实现大规模语料的扩展标注。
原文摘要 · Abstract (English)
Factuality assesses the extent to which a language utterance relates to real-world information; it determines whether utterances correspond to facts, possibilities, or imaginary situations, and as such, it is instrumental for fact checking. Factuality is a complex notion that relies on multiple linguistic signals, and has been studied in various disciplines. We present a complex, multi-faceted annotation scheme of factuality that combines concepts from a variety of previous works. We developed the scheme for Hebrew, but we trust that it can be adapted to other languages. We also present a set of almost 5,000 sentences in the domain of parliamentary discourse that we manually annotated according to this scheme. We report on inter-annotator agreement, and experiment with various approaches to automatically predict (some features of) the scheme, in order to extend the annotation to a large corpus.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。