自适应查询扩展让AI文档生成更准更全,适合构建可信大模型系统。
AdaQE-CG: Adaptive Query Expansion for Web-Scale Generative AI Model and Data Card Generation

- 动态优化提取查询,从论文中挖出更多完整信息
- 跨卡片迁移知识,补全缺失字段,提升文档完整性
- 首个专家标注的大规模评测基准,可公平比较生成质量
透明且标准化的文档对构建可信生成式人工智能(GAI)系统至关重要。然而,现有的自动化模型与数据卡片生成方法仍面临三大挑战:(i) 静态模板问题,多数系统依赖固定查询模板,无法适应多样化的论文结构或不断演进的文档需求;(ii) 信息不足,网络级仓库如Hugging Face常含不完整或不一致的元数据,导致信息缺失或噪声;(iii) 缺乏评估基准,缺乏标准化数据集与评估协议,阻碍了文档质量的公平、可复现评估。为此,我们提出AdaQE-CG框架,结合动态信息抽取与跨卡片知识迁移,实现自适应文档生成。其内部论文信息提取模块(IPE-QE)通过上下文感知的查询扩展迭代优化,从学术论文与仓库中恢复更丰富、完整的文本信息;其跨卡片补全模块(ICC-MP)则利用精心构建的MetaGAI Pool,从相似卡片中迁移语义相关的内容以填补空白字段。此外,我们构建了首个大规模、专家标注的评测基准MetaGAI-Bench,用于评估GAI文档质量。在五个质量维度上的全面实验表明,AdaQE-CG显著优于现有方法,超越人工撰写的资料卡表现,并接近人工撰写模型卡的人类水平。代码、提示词与数据已公开于:https://github.com/haoxuan-unt2024/AdaQE-CG。
原文摘要 · Abstract (English)
Transparent and standardized documentation is essential for building trustworthy generative AI (GAI) systems. However, existing automated methods for generating model and data cards still face three major challenges: (i) static templates, as most systems rely on fixed query templates that cannot adapt to diverse paper structures or evolving documentation requirements; (ii) information scarcity, since web-scale repositories such as Hugging Face often contain incomplete or inconsistent metadata, leading to missing or noisy information; and (iii) lack of benchmarks, as the absence of standardized datasets and evaluation protocols hinders fair and reproducible assessment of documentation quality. To address these limitations, we propose AdaQE-CG, an Adaptive Query Expansion for Card Generation framework that combines dynamic information extraction with cross-card knowledge transfer. Its Intra-Paper Extraction via Context-Aware Query Expansion (IPE-QE) module iteratively refines extraction queries to recover richer and more complete information from scientific papers and repositories, while its Inter-Card Completion using the MetaGAI Pool (ICC-MP) module fills missing fields by transferring semantically relevant content from similar cards in a curated dataset. In addition, we introduce MetaGAI-Bench, the first large-scale, expert-annotated benchmark for evaluating GAI documentation. Comprehensive experiments across five quality dimensions show that AdaQE-CG substantially outperforms existing approaches, exceeds human-authored data cards, and approaches human-level quality for model cards. Code, prompts, and data are publicly available at: https://github.com/haoxuan-unt2024/AdaQE-CG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。