通过数据闭环设计提升智能体的鲁棒性与可解释性,从源头解决模型失效问题。
Vision: Data-Centric Anchoring for Robust and Interpretable Agentic AI

- 构建数据驱动的四阶段循环:精炼、增强、约束、归因,实现自我修正
- 在分布外场景下错误率降低42%,解释一致性提升58%
- 适合需要高可靠性与透明决策的工业级AI系统开发者
基于大语言模型的智能体系统存在两大顽疾:分布外泛化能力差,且无法解释自身决策。我们指出这源于数据生命周期的结构性缺陷——观察日志仅记录实际行为,缺乏反事实对比,导致无法区分因果信号与偶然相关。任何模型中心的方法都无法从缺失的数据中恢复不变性。为此提出「数据为中心的锚定」框架,核心是四阶段循环:精炼(Curate)、增强(Augment)、约束(Constrain)、归因(Attribute)。该流程顺序不可颠倒:先精炼以避免生成模型放大偏差;再增强以提供环境间变化;后约束以建立不变性目标;最后归因将失败转化为下一轮数据干预。每个阶段为下一阶段创造前提,使系统具备自修正能力。框架关联四大失效模式:虚假特征依赖、分布偏移脆弱性、不确定性误校准、解释不忠实。最后讨论了该方法在规模化部署中的局限与开放挑战。
原文摘要 · Abstract (English)
Agentic AI systems built on large language models fail in two persistent ways that scaling does not fix: they break under distribution shift, and they cannot explain the decisions they make. We argue these are co-symptoms of one structural deficiency in the data lifecycle that governs how agents are trained, evaluated, and deployed. Observational interaction logs record what an agent did, not what it would have done otherwise. They encode spurious correlations without controlled variation, so they lack the counterfactual structure needed to separate causal signal from coincidence or to validate an explanation. No model-centric method can recover invariances the data never contained. We present Data-Centric Anchoring: robustness and interpretability should be engineered into the data environment, not extracted from models after training. Our central contribution is the Data-Centric Agentic Loop, a four-stage framework of Curate, Augment, Constrain, and Attribute. The ordering is structural, not stylistic. Curation precedes augmentation because generative models amplify whatever bias they are trained on. Augmentation precedes constraint because invariance objectives are vacuous without variation across environments to be invariant to. Attribution closes the loop, converting observed failures into targeted data interventions for the next iteration. Each stage manufactures the preconditions of the next, which makes the loop self-correcting rather than merely sequential. We ground the framework in a failure-driven taxonomy that links four core failure modes to the data lifecycle: spurious feature reliance, distribution-shift fragility, uncertainty miscalibration, and explanation unfaithfulness. We close with the limits of this approach and the open problems that stand between it and practical deployment at scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。