用大模型推理+人工规则,零样本检测表格错误更准更省力
ZeroED: Hybrid Zero-shot Error Detection through Large Language Model Reasoning
- 结合大模型推理与人工规则,分四步构建检测流程
- 在7个数据集上F1最高提升30%,令牌消耗减少90%
- 适合缺乏标注数据的表格清洗场景,尤其适合自动化纠错
表格数据中的错误检测(ED)至关重要却极具挑战,因错误类型多样且需上下文理解。传统方法依赖大量人工规则和标注,成本高。大语言模型(LLM)可降低人力但难以把握复杂上下文。本文提出ZeroED,一种融合LLM推理与人工标签的混合零样本错误检测框架。该框架分四步:特征表示、错误标注、训练数据构建、检测器训练。首先,通过误差原因感知的二值特征、预训练嵌入与统计特征生成丰富数据表征;其次,利用LLM通过上下文学习进行整体错误标注,基于两步推理流程提供详细检测指引;为降低令牌开销,仅对聚类采样的代表性数据应用LLM;通过聚类内标签传播与LLM增强并验证,构建高质量训练数据;最后训练分类器以识别所有错误。在七个公开数据集上的实验表明,ZeroED相比现有最优方法,F1分数最高提升30%,令牌使用量最多减少90%。
原文摘要 · Abstract (English)
Error detection (ED) in tabular data is crucial yet challenging due to diverse error types and the need for contextual understanding. Traditional ED methods often rely heavily on manual criteria and labels, making them labor-intensive. Large language models (LLM) can minimize human effort but struggle with errors requiring a comprehensive understanding of data context. In this paper, we propose ZeroED, a novel hybrid zero-shot error detection framework, which combines LLM reasoning ability with the manual label-based ED pipeline. ZeroED operates in four steps, i.e., feature representation, error labeling, training data construction, and detector training. Initially, to enhance error distinction, ZeroED generates rich data representations using error reason-aware binary features, pre-trained embeddings, and statistical features. Then, ZeroED employs LLM to label errors holistically through in-context learning, guided by a two-step reasoning process for detailed error detection guidelines. To reduce token costs, LLMs are applied only to representative data selected via clustering-based sampling. High-quality training data is constructed through in-cluster label propagation and LLM augmentation with verification. Finally, a classifier is trained to detect all errors. Extensive experiments on seven public datasets demonstrate that, ZeroED substantially outperforms state-of-the-art methods by a maximum 30% improvement in F1 score and up to 90% token cost reduction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。