让智能体系统成为大模型应对分布外问题的新范式。
Agentic AIs Are the Missing Paradigm for Out-of-Distribution Generalization in Foundation Models

- 提出分阶段形式化OOD,兼容训练数据不完整的情况。
- 证明参数化模型存在不可逾越的处理能力上限。
- 强调智能体具感知、策略、行动和闭环验证能力,可突破极限。
基础模型(FMs)越来越多部署在开放世界中,分布偏移是常态而非例外。它们面临的分布外(OOD)现象——知识边界、能力天花板、组合性变化及开放任务多样性——与以往研究设定截然不同,且现代模型的预训练与后训练分布往往仅部分可观测。我们认为,基础模型的OOD问题是结构性独特的难题,无法通过现有以模型为中心的范式解决,而智能体系统正是缺失的关键范式。本文通过四步论证:首先,提出一种考虑多阶段训练分布的部分可观测性的阶段感知型OOD形式化;其次,证明参数覆盖存在理论上限:对于某些实际输入,无论训练时或推理时的方法,均无法在容差ε内处理,这源于参数表示的本质限制;第三,定义智能体OOD系统的四大结构特征——感知、策略选择、外部行动、闭环验证,并表明其可严格扩展可处理范围,突破上述上限;第四,回应七个反论,承认其中两个,提出研究议程。我们不认为智能体方法能取代模型中心方法,而是主张二者互补,推动基础模型的分布外泛化需将智能体范式视为首要研究方向。
原文摘要 · Abstract (English)
Foundation models (FMs) are increasingly deployed in open-world settings where distribution shift is the rule rather than the exception. The out-of-distribution (OOD) phenomena they face -- knowledge boundaries, capability ceilings, compositional shifts, and open-ended task variation -- differ in kind from the settings that have shaped prior OOD research, and are further complicated because the pretraining and post-training distributions of modern FMs are often only partially observed. Our position is that OOD for foundation models is a structurally distinct problem that cannot be solved within the prevailing model-centric paradigm, and that agentic systems constitute the missing paradigm required to address it. We defend this claim through four steps. First, we give a stage-aware formalization of OOD that accommodates partially observed multi-stage training distributions. Second, we prove a parameter coverage ceiling: there exist practically relevant inputs that no model-centric method (training-time or test-time) can handle within tolerance $\varepsilon$, for reasons intrinsic to parameter-based representation. Third, we characterize agentic OOD systems by four structural properties -- perception, strategy selection, external action, and closed-loop verification -- and show that they strictly extend the reachable set beyond the ceiling. Fourth, we respond to seven counterarguments, conceding two, and outline a research agenda. We do not claim that agentic methods subsume model-centric ones; we argue that the two are complementary, and that progress on FM-OOD requires explicit recognition of the agentic paradigm as a first-class research direction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。