arXiv:2504.05210cs.CYcs.AI2025-04被引 8

模型定期更新会引入新透明度问题,影响用户对AI决策的理解。

A moving target in AI-assisted decision-making: Dataset shift, model updating, and the problem of update opacity

  • 提出'更新不透明'概念:用户无法理解模型更新如何改变其行为。
  • 指出现有可解释性方法难以应对更新带来的认知障碍。
  • 适合关注AI伦理与决策可信度的研究者和实践者阅读。

机器学习系统因数据分布随时间变化而性能下降,因此常建议定期更新模型以维持稳定性。然而,现有研究较少关注模型更新对机器学习辅助决策过程本身的影响,尤其在人工智能伦理与认识论领域。本文旨在填补这一空白,提出模型更新会引入一种新型不透明性——更新不透明性,即用户无法理解模型更新如何改变其推理或行为。这种不透明性带来独特的认识论与安全挑战,现有针对黑箱问题的解决方案对此类问题应对能力有限。文中探讨了双事实解释、动态模型报告与更新兼容性等潜在对策,但每种方法均存在自身风险或显著局限。未来需进一步研究以应对模型更新及更新不透明性所引发的认识论与安全问题。

原文摘要 · Abstract (English)

Machine learning (ML) systems are vulnerable to performance decline over time due to dataset shift. To address this problem, experts often suggest that ML systems should be regularly updated to ensure ongoing performance stability. Some scholarly literature has begun to address the epistemic and ethical challenges associated with different updating methodologies. Thus far, however, little attention has been paid to the impact of model updating on the ML-assisted decision-making process itself, particularly in the AI ethics and AI epistemology literatures. This article aims to address this gap in the literature. It argues that model updating introduces a new sub-type of opacity into ML-assisted decision-making -- update opacity -- that occurs when users cannot understand how or why an update has changed the reasoning or behaviour of an ML system. This type of opacity presents a variety of distinctive epistemic and safety concerns that available solutions to the black box problem in ML are largely ill-equipped to address. A variety of alternative strategies may be developed or pursued to address the problem of update opacity more directly, including bi-factual explanations, dynamic model reporting, and update compatibility. However, each of these strategies presents its own risks or carries significant limitations. Further research will be needed to address the epistemic and safety concerns associated with model updating and update opacity going forward.

AI伦理模型更新透明度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。