arXiv:2512.01899cs.LGstat.ML2025-12中稿 · publication at SaT…被引 1

提出可证明安全的模型更新框架,确保参数调整不破坏性能规范。

Provably Safe Model Updates

  • 通过计算参数空间中安全区域,实现更新前的严格验证
  • 在持续学习与大模型微调任务中避免遗忘,效果优于传统方法
  • 适合对安全性要求高的场景,如自动驾驶、医疗决策

安全关键环境具有固有的动态性。分布偏移、新出现的漏洞和不断变化的需求要求对机器学习模型进行持续更新。然而,即使无害的参数更新也可能带来意外后果,如经典模型中的灾难性遗忘或基础模型中的对齐漂移。现有的启发式方法(如正则化、参数隔离)虽能缓解这些影响,但无法证明更新后的模型仍满足既定性能规范。本文提出一个可证明安全的模型更新框架。首先将问题形式化为计算最大局部不变域(LID):参数空间中一个连通区域,其中所有点均被认证满足给定规范。虽然精确求解最大LID不可行,但我们证明,将问题放松至参数化抽象域(矩形、区段)后,可获得可计算的原对偶公式。这使得更新能够独立于数据或算法地投影到安全域中进行高效认证。该框架还可计算多个近似最优的LID,融入正则化引导的先验偏好,并使用前瞻数据缓冲。在持续学习与基础模型微调基准上,本方法在避免遗忘方面达到或超过启发式基线,同时提供形式化安全保证。

原文摘要 · Abstract (English)

Safety-critical environments are inherently dynamic. Distribution shifts, emerging vulnerabilities, and evolving requirements demand continuous updates to machine learning models. Yet even benign parameter updates can have unintended consequences, such as catastrophic forgetting in classical models or alignment drift in foundation models. Existing heuristic approaches (e.g., regularization, parameter isolation) can mitigate these effects but cannot certify that updated models continue to satisfy required performance specifications. We address this problem by introducing a framework for provably safe model updates. Our approach first formalizes the problem as computing the largest locally invariant domain (LID): a connected region in parameter space where all points are certified to satisfy a given specification. While exact maximal LID computation is intractable, we show that relaxing the problem to parameterized abstract domains (orthotopes, zonotopes) yields a tractable primal-dual formulation. This enables efficient certification of updates - independent of the data or algorithm used - by projecting them onto the safe domain. Our formulation further allows computation of multiple approximately optimal LIDs, incorporation of regularization-inspired biases, and use of lookahead data buffers. Across continual learning and foundation model fine-tuning benchmarks, our method matches or exceeds heuristic baselines for avoiding forgetting while providing formal safety guarantees.

模型更新安全验证持续学习形式化保证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。