用智能体+检索实现自动化的数据质量评估,能随使用场景自适应调整。
An Agentic Retrieval Framework for Autonomous Context-Aware Data Quality Assessment

- 通过多智能体流程解析用途描述,生成上下文相关的评估策略。
- 在执行前验证规则可行性,减少无效规则,提升结果可复现性。
- 适合需要自动化又保证安全可控的数据治理场景。
数据质量评估是有效数据分析与决策的前提,但其固有的上下文依赖性使其难以自动化。现有方法多依赖静态规则或人工判断,难以适应多样应用场景且限制规模化自动执行。近年来大语言模型为自动化数据质量评估带来新机遇,但也引发可靠性、事实依据与执行安全等问题。本文提出一种统一的智能体-检索框架,用于自主、上下文感知的数据质量评估:该框架解析自然语言描述的使用意图,推导出上下文相关的评估策略,并通过多智能体工作流生成可执行的验证逻辑。为保障操作可靠性,框架引入可行性验证阶段,在执行前评估生成规则的真实性与可执行性,必要时支持迭代优化。通过确定性执行,确保结果可复现且可审计。我们构建了端到端原型,在同一数据集上针对多种使用场景进行评估。结果表明,评估结果能根据不同使用意图合理调整,且可行性约束显著降低了不现实或不可执行规则的生成。该方法为现代数据驱动环境中部署自主可控的数据质量评估提供了实用基础。
原文摘要 · Abstract (English)
Data quality assessment is a critical prerequisite for effective data analytics and data-driven decision-making, yet it remains a challenging task due to the inherently context-dependent nature of data quality. Existing approaches often rely on static rules or manual assessment strategies, limiting their adaptability to diverse usage scenarios and constraining automation at scale. Recent advances in artificial intelligence, particularly large language models, offer new opportunities for automating data quality assessment, but raise concerns related to reliability, grounding, and execution safety. In this paper, we propose a unified agentic-retrieval framework for autonomous context-aware data quality assessment. The framework interprets natural-language descriptions of intended data usage, derives context-aware assessment strategies, and generates executable validation logic through a multi-agent workflow. To ensure operational reliability, the framework introduces a feasibility validation stage that evaluates the realism and executability of generated assessment specifications before execution, enabling iterative refinement when necessary. Accepted validation logic is executed deterministically to guarantee reproducible and auditable results. We implement the proposed framework as an end-to-end prototype and evaluate it across multiple usage scenarios applied to the same dataset. The results demonstrate that assessment outcomes adapt meaningfully to different intended uses, while feasibility-gated execution reduces unrealistic or non-executable rule generation. The proposed approach provides a practical foundation for deploying autonomous yet controlled data quality assessment in modern data-driven environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。