跨语言维基百科表格存在事实不一致,影响AI训练可靠性。
Factual Inconsistencies in Multilingual Wikipedia Tables
- 构建多语言表格对齐分析方法,识别跨语种内容差异
- 发现多语言版本表格在关键信息上存在显著事实不一致
- 适用于知识验证、多语言AI系统设计与维基内容改进
维基百科提供超过300种语言的内容,尽管覆盖相同主题,但各语言版本独立编写与更新,导致事实不一致,影响其中立性与可靠性,并对依赖维基百科作为主要训练数据的AI系统造成潜在影响。本研究聚焦于维基百科结构化内容中的跨语言不一致问题,开发了一套方法用于收集、对齐和分析多语言文章中的表格数据,定义了不一致类别。通过样本数据集,应用多种定量与定性指标评估多语言对齐程度。研究结果为事实核查、多语言知识交互及基于维基内容的可靠AI系统设计提供了重要启示。
原文摘要 · Abstract (English)
Wikipedia serves as a globally accessible knowledge source with content in over 300 languages. Despite covering the same topics, the different versions of Wikipedia are written and updated independently. This leads to factual inconsistencies that can impact the neutrality and reliability of the encyclopedia and AI systems, which often rely on Wikipedia as a main training source. This study investigates cross-lingual inconsistencies in Wikipedia's structured content, with a focus on tabular data. We developed a methodology to collect, align, and analyze tables from Wikipedia multilingual articles, defining categories of inconsistency. We apply various quantitative and qualitative metrics to assess multilingual alignment using a sample dataset. These insights have implications for factual verification, multilingual knowledge interaction, and design for reliable AI systems leveraging Wikipedia content.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。