arXiv:2507.03146cs.LG2025-07ICML被引 1

用预测集合提升未知领域下的模型鲁棒性,兼顾准确性与紧凑性。

Set Valued Predictions For Robust Domain Generalization

  • 采用预测集合替代单一预测,增强跨领域泛化能力
  • 在WILDS多个数据集上实现更高且稳定的未知领域性能
  • 适合对模型可靠性要求高的实际应用,如医疗、自动驾驶

尽管现代机器学习发展迅速,但在领域泛化(DG)任务中实现鲁棒性仍是重大挑战。在DG中,模型需在未见的测试分布(即领域)上表现良好,仅通过多个相关训练分布进行学习。现有方法多依赖单值预测,天然限制了鲁棒性。本文主张利用集合预测来提升跨未知领域的鲁棒性,同时确保集合尽可能小。我们提出一个理论框架,定义了在DG设置下成功集合预测的标准:在尽可能多的领域中满足预设性能指标,并提供关于此类泛化可实现性的理论洞见。此外,我们设计了一种与现代学习架构兼容的实用优化方法,在未知领域上的稳健表现与预测集合大小之间取得平衡。我们在WILDS基准的多个真实世界数据集上评估了该方法,证明其作为鲁棒领域泛化有前景的新方向。

原文摘要 · Abstract (English)

Despite the impressive advancements in modern machine learning, achieving robustness in Domain Generalization (DG) tasks remains a significant challenge. In DG, models are expected to perform well on samples from unseen test distributions (also called domains), by learning from multiple related training distributions. Most existing approaches to this problem rely on single-valued predictions, which inherently limit their robustness. We argue that set-valued predictors could be leveraged to enhance robustness across unseen domains, while also taking into account that these sets should be as small as possible. We introduce a theoretical framework defining successful set prediction in the DG setting, focusing on meeting a predefined performance criterion across as many domains as possible, and provide theoretical insights into the conditions under which such domain generalization is achievable. We further propose a practical optimization method compatible with modern learning architectures, that balances robust performance on unseen domains with small prediction set sizes. We evaluate our approach on several real-world datasets from the WILDS benchmark, demonstrating its potential as a promising direction for robust domain generalization.

领域泛化集合预测鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。