让AI学会评估自身不确定性,提升决策可靠性。
Probabilistic Artificial Intelligence
- 用概率模型区分可减少的不确定性和固有噪声
- 结合不确定性优化数据采集与强化学习探索
- 适合关注AI安全、可靠决策的研究者
人工智能通常指能够执行人类智能相关任务(如游戏、翻译、自动驾驶)的系统。近年来,基于学习的数据驱动方法取得显著进展,机器学习与深度学习使计算机对世界感知能力大幅提升。强化学习在围棋等复杂游戏及四足机器人行走等挑战性任务中实现突破。智能的核心不仅在于预测,更在于对预测不确定性的推理,并据此做出决策。本文聚焦概率人工智能:第一部分介绍机器学习中的概率方法,区分因数据不足导致的“认知不确定性”与由观测噪声等引起的“随机不确定性”,并讨论概率推断及高效近似推断技术;第二部分探讨如何在序列决策任务中考虑不确定性,包括主动学习与贝叶斯优化——通过设计能减少认知不确定性的实验来收集数据;随后分析强化学习与现代深度强化学习中神经网络函数逼近的应用;最后讨论基于模型的强化学习,利用认知与随机不确定性指导探索,同时兼顾安全性。
原文摘要 · Abstract (English)
Artificial intelligence commonly refers to the science and engineering of artificial systems that can carry out tasks generally associated with requiring aspects of human intelligence, such as playing games, translating languages, and driving cars. In recent years, there have been exciting advances in learning-based, data-driven approaches towards AI, and machine learning and deep learning have enabled computer systems to perceive the world in unprecedented ways. Reinforcement learning has enabled breakthroughs in complex games such as Go and challenging robotics tasks such as quadrupedal locomotion. A key aspect of intelligence is to not only make predictions, but reason about the uncertainty in these predictions, and to consider this uncertainty when making decisions. This is what this manuscript on "Probabilistic Artificial Intelligence" is about. The first part covers probabilistic approaches to machine learning. We discuss the differentiation between "epistemic" uncertainty due to lack of data and "aleatoric" uncertainty, which is irreducible and stems, e.g., from noisy observations and outcomes. We discuss concrete approaches towards probabilistic inference and modern approaches to efficient approximate inference. The second part of the manuscript is about taking uncertainty into account in sequential decision tasks. We consider active learning and Bayesian optimization -- approaches that collect data by proposing experiments that are informative for reducing the epistemic uncertainty. We then consider reinforcement learning and modern deep RL approaches that use neural network function approximation. We close by discussing modern approaches in model-based RL, which harness epistemic and aleatoric uncertainty to guide exploration, while also reasoning about safety.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。