ZTab通过域配置实现零样本表列语义类型自动标注,兼顾性能与隐私。
ZTab: Domain-based Zero-shot Annotation for Table Columns
- 基于预定义域配置生成伪表,微调标注大模型
- 在通用域下接近纯零样本,在专有域下性能更优
- 无需用户标注数据,适合隐私敏感或数据稀缺场景
本研究解决关系表中语义列类型自动检测的挑战,这是众多实际应用的关键任务。零样本建模无需用户提供的标注训练数据,适用于数据收集成本高或因隐私限制难以获取的情况。然而,现有零样本模型在语义列类型数量较多时表现不佳,对表格结构理解有限,且依赖高性能闭源大模型带来隐私风险。我们提出ZTab,一种基于域的零样本框架,同时满足性能与零样本要求。给定包含一组预定义语义类型和样本表模式的域配置,ZTab为样本模式生成伪表,并在此基础上微调标注大模型。ZTab是域基础的零样本方法,不依赖用户特定标注数据,因此对于同领域测试表无需重新训练。我们描述了三种域基础零样本情形。域配置在零样本程度与标注性能间提供权衡:包含所有语义类型的‘通用域’接近‘纯’零样本,而针对特定应用的‘专用域’则在该领域内实现更好零样本性能。源代码与数据集见 https://github.com/hoseinzadeehsan/ZTab
原文摘要 · Abstract (English)
This study addresses the challenge of automatically detecting semantic column types in relational tables, a key task in many real-world applications. Zero-shot modeling eliminates the need for user-provided labeled training data, making it ideal for scenarios where data collection is costly or restricted due to privacy concerns. However, existing zero-shot models suffer from poor performance when the number of semantic column types is large, limited understanding of tabular structure, and privacy risks arising from dependence on high-performance closed-source LLMs. We introduce ZTab, a domain-based zero-shot framework that addresses both performance and zero-shot requirements. Given a domain configuration consisting of a set of predefined semantic types and sample table schemas, ZTab generates pseudo-tables for the sample schemas and fine-tunes an annotation LLM on them. ZTab is domain-based zero-shot in that it does not depend on user-specific labeled training data; therefore, no retraining is needed for a test table from a similar domain. We describe three cases of domain-based zero-shot. The domain configuration of ZTab provides a trade-off between the extent of zero-shot and annotation performance: a "universal domain" that contains all semantic types approaches "pure" zero-shot, while a "specialized domain" that contains semantic types for a specific application enables better zero-shot performance within that domain. Source code and datasets are available at https://github.com/hoseinzadeehsan/ZTab
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。