arXiv:2504.14751cs.LGcs.AI2025-04被引 2

探索开放世界AI的三大学习原则,突破传统封闭世界的局限。

AI for the Open-World: the Learning Principles

  • 提出三大开放世界学习原则:丰富特征、解耦表示、推理时学习。
  • 实验证明这些原则可有效提升少样本场景下的泛化能力。
  • 适合关注通用人工智能与持续学习的研究者阅读。

过去几十年,人工智能在特定任务(封闭世界)中取得诸多成功,如人工环境或具体现实任务。这类任务具有明确的成功标准和大量数据,使问题可逐步修正。然而,封闭世界中的成功难以迁移至开放世界——即机器需应对人类可能执行的任意任务,且样本极少、先验知识有限。因为特定任务的胜任力无法提供跨任务洞察,原有评估标准失效;同时数据稀缺使中心极限定理不再适用,导致人类设计者失去调试依据。因此,实现开放世界人工智能需全新的学习原则与技术。本文探讨构建开放世界AI所必需的学习原则:丰富特征(类比大型工具箱)、解耦表示(有序的工具箱)、推理时学习(善用工具的手)。基于这些原则,本文提出相应技术,并通过大规模实验验证其有效性。

原文摘要 · Abstract (English)

During the past decades, numerous successes of AI has been made on "specific capabilities", named closed-world, such as artificial environments or specific real-world tasks. This well-defined narrow capability brings two nice benefits, a clear criterion of success and the opportunity to collect a lot of examples. The criteria not only reveal whether a machine has achieved a goal, but reveal how the machine falls short of the goal. As a result, human designers can fix the problems one after the other until the machine is deemed good enough for the task. Furthermore, the large set of collected examples reduces the difficulty of this problem-fixing process (by the central limit theorem). Do the success in closed-world translate into broad open-world, where a machine is required to perform any task that a human could possibly undertake with fewer examples and less priori knowledge from human designers? No. Because competence in a specific task provides little insight in handling other tasks, the valuable criteria for specific tasks become helpless when handling broader unseen tasks. Furthermore, due to the shortage of examples in unseen tasks, central limit theorem does not stand on our side. At the end, human designers lose the oscilloscope to "hack" an AI system for the open-world. Achieving AI for the open-world requires unique learning principles and innovated techniques, which are different from the ones in building AI for the closed-world. This thesis explores necessary learning principles required to construct AI for the open-world, including rich features (analogy a large tool box), disentangled representation (an organized tool box), and inference-time learning (a tool-savvy hand). Driven by the learning principles, this thesis further proposes techniques to use the learning principles, conducts enormous large-scale experiments to verify the learning principles.

开放世界学习原则通用AI少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。