解决交互式机器学习中数据标注贵、决策风险高难题
Interactive Machine Learning: From Theory to Scale
- 设计新算法实现高效主动学习,无需低噪声假设即可节省大量标签
- 提出首个与动作空间大小无关的通用上下文老虎机算法,计算高效
- 首次精确刻画模型选择在序列决策中的根本代价,指导实际部署
机器学习虽在众多应用中取得显著成功,但许多高效方法依赖大量标注数据或长时间在线交互。现实中,获取高质量标签或通过试错做决策往往成本高、耗时长甚至存在风险,尤其在大规模或高风险场景下。本文研究交互式机器学习,即学习者主动影响信息收集方式或行动选择,利用历史观测指导未来交互。研究覆盖三个维度:含噪声数据与复杂模型类的主动学习、大规模动作空间的序列决策、部分反馈下的模型选择。成果包括首个无需低噪声假设即可实现指数级标签节省的计算高效主动学习算法;首个不依赖动作空间大小、具备理论保障的通用上下文老虎机算法;以及首次对序列决策中模型选择基本代价的紧致刻画。整体上,本论文推进了交互式学习的理论基础,发展出兼具统计最优性与计算效率的算法,并为大规模真实场景部署提供原则性指导。
原文摘要 · Abstract (English)
Machine learning has achieved remarkable success across a wide range of applications, yet many of its most effective methods rely on access to large amounts of labeled data or extensive online interaction. In practice, acquiring high-quality labels and making decisions through trial-and-error can be expensive, time-consuming, or risky, particularly in large-scale or high-stakes settings. This dissertation studies interactive machine learning, in which the learner actively influences how information is collected or which actions are taken, using past observations to guide future interactions. We develop new algorithmic principles and establish fundamental limits for interactive learning along three dimensions: active learning with noisy data and rich model classes, sequential decision making with large action spaces, and model selection under partial feedback. Our results include the first computationally efficient active learning algorithms achieving exponential label savings without low-noise assumptions; the first efficient, general-purpose contextual bandit algorithms whose guarantees are independent of the size of the action space; and the first tight characterizations of the fundamental cost of model selection in sequential decision making. Overall, this dissertation advances the theoretical foundations of interactive learning by developing algorithms that are statistically optimal and computationally efficient, while also providing principled guidance for deploying interactive learning methods in large-scale, real-world settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。