用大模型自动补全表格字段说明,让数据更易懂好用。
TACO: Task-Aware Column Description Generation Using LLMs

- 分三步处理:先扩写缩写,再生成带关键词的描述,最后模拟下游任务优化结果。
- 在多个数据集上提升下游任务准确率最高达32%,效果显著优于现有方法。
- 适合数据治理、智能查询等场景,尤其对缺乏文档的业务数据有用。
为表格数据生成准确且信息丰富的字段说明(如将'cust_mem'解释为'客户会员状态')对自然语言转SQL、表格问答和实体链接等下游NLP任务至关重要。然而,真实数据常因字段名缩写或领域术语导致文档缺失或晦涩。现有基于单次提示的大模型方法存在三类问题:(i)缩写处理不一致或错误,(ii)生成内容虚构或不完整,(iii)描述冗余模糊影响下游性能。本文提出TACO,一种任务感知的自动字段描述生成框架。TACO采用三阶段流程:(1)缩写扩展,统一字段名称;(2)描述生成,产出含同义词与搜索关键词的语义描述;(3)描述修订,通过模拟下游任务进行优化。我们还探索了人机协同方案,并发布了用于实体链接与模式扩充的新评估数据集。在公开与私有数据集上的大量实验表明,TACO持续优于现有方法,使下游任务性能最高提升32%。
原文摘要 · Abstract (English)
Generating accurate and informative column descriptions (e.g. "membership status of customers" for the column name "cust_mem") is essential for a wide range of downstream NLP tasks on tabular data, including NL2SQL, table question answering, and entity linking. This problem arises in enterprises, domain sciences, government data portals, and so on. Despite its importance, most real-world datasets suffer from missing or cryptic documentation, often due to abbreviated column names or domain-specific jargon. Existing approaches largely rely on single-prompt large language models (LLMs), which struggle with three key issues: (i) inconsistent or incorrect handling of abbreviations, (ii) hallucinated or incomplete descriptions, and (iii) redundancy or vagueness that hinders downstream performance. We present TACO, a task-aware framework for automatic column description generation using LLMs. TACO introduces a three-step pipeline: (1) abbreviation expansion, which standardizes column names; (2) description generation, which produces initial semantic descriptions enriched with synonyms and search-oriented keywords; and (3) description revision, which refines these outputs using simulated downstream tasks. In addition, we investigate human-in-the-loop extensions and release new evaluation datasets for entity linking and schema enrichment. Extensive experiments across public and proprietary datasets show that TACO consistently outperforms existing methods, improving downstream task performance by up to 32%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。