通过分解推理链生成纠错数据,提升复杂事实错误修正能力
CECOR: Correction-oriented synthetic data construction for factual error correction
- 将多跳错误拆解为可解释的推理步骤,注入可控扰动生成训练数据
- 在多跳基准上超越远监督方法和少样本大模型基线
- 兼顾单跳纠错与噪声证据下的稳定性,适合真实场景应用
事实错误修正(FEC)旨在将不准确文本修改为与外部证据一致的陈述。尽管近期方法在单跳修正上表现良好,但通常将论断视为原子单元,难以处理需跨多个证据源进行组合推理的多跳案例。这一挑战因配对数据有限及复杂推理链中语义错误定位困难而加剧。我们提出CECoR(基于推理感知合成的组合式错误修正),引入分解与注入范式以支持组合式错误修正。该方法将多跳论断分解为可解释的推理步骤,并注入受控扰动以合成高质量训练对。采用监督微调与强化学习相结合的两阶段学习策略,提升了事实准确性与鲁棒性。全面评估显示,CECoR在多跳基准上表现优异,优于远监督方法和少样本大模型基线。其在单跳修正任务中也具有良好泛化能力,且在噪声证据下保持稳定,展现出真实世界事实修正的强适应性。
原文摘要 · Abstract (English)
Factual Error Correction (FEC) aims to revise inaccurate text into statements that are factually consistent with external evidence. Although recent methods perform well on single-hop correction, they often treat claims as atomic units and struggle with multi-hop cases that require compositional reasoning across multiple evidence sources. This challenge is further amplified by limited paired data and difficulties in locating semantic errors within complex reasoning chains. We present CECoR (Compositional Error Correction via Reasoning-aware Synthesis), a reasoning-aware framework that introduces a Decomposition and Injection paradigm for compositional error correction. CECoR decomposes multi-hop claims into interpretable reasoning steps and injects controlled perturbations to synthesize high-quality training pairs. A two-stage learning strategy combining supervised fine-tuning and reinforcement learning improves factual accuracy and robustness. Comprehensive evaluations show that CECoR achieves strong performance on multi-hop benchmarks, outperforming both distantly supervised methods and few-shot LLM baselines. It also generalizes effectively to single-hop correction and remains stable under noisy evidence, demonstrating its versatility for real-world factual correction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。