arXiv:2504.19472cs.CL2025-04EMNLP被引 3

梳理文本中冲突的三类来源及应对挑战

Conflicts in Texts: Data, Implications and Challenges

  • 将文本冲突分为网络文本、标注数据、模型交互三类
  • 指出忽略冲突会降低模型可靠性与可信度
  • 适合关注模型鲁棒性与可信AI的研究者

随着自然语言处理模型在现实应用中的普及,模型依赖和生成矛盾信息的问题日益凸显。这些冲突可能源于事实不一致、主观偏见、多重视角、标注者分歧、社会偏见或模型幻觉等。本文系统梳理了三类核心冲突:(1) 网络自然文本中的事实矛盾、主观偏见与多元观点;(2) 人工标注数据中的标注分歧、错误与社会偏见;(3) 模型部署阶段出现的幻觉与知识冲突。尽管已有研究分别处理部分问题,但本文首次将它们统一为‘冲突信息’范畴,分析其影响并探讨缓解策略,提出构建具备冲突感知能力的NLP系统的挑战与未来方向。

原文摘要 · Abstract (English)

As NLP models become increasingly integrated into real-world applications, it becomes clear that there is a need to address the fact that models often rely on and generate conflicting information. Conflicts could reflect the complexity of situations, changes that need to be explained and dealt with, difficulties in data annotation, and mistakes in generated outputs. In all cases, disregarding the conflicts in data could result in undesired behaviors of models and undermine NLP models' reliability and trustworthiness. This survey categorizes these conflicts into three key areas: (1) natural texts on the web, where factual inconsistencies, subjective biases, and multiple perspectives introduce contradictions; (2) human-annotated data, where annotator disagreements, mistakes, and societal biases impact model training; and (3) model interactions, where hallucinations and knowledge conflicts emerge during deployment. While prior work has addressed some of these conflicts in isolation, we unify them under the broader concept of conflicting information, analyze their implications, and discuss mitigation strategies. We highlight key challenges and future directions for developing conflict-aware NLP systems that can reason over and reconcile conflicting information more effectively.

冲突检测模型可信度数据质量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。