arXiv:2512.15469cs.LG2025-12

用神经网络编辑器一键调整模型,满足合规性又不丢性能。

Metanetworks as Regulatory Operators: Learning to Edit for Requirement Compliance

  • 用图结构元网络做编辑器,一次推理完成模型修改。
  • 在数据最小化、去偏见、剪枝任务上平衡性能与合规性。
  • 适合需快速合规的高风险场景,如医疗、金融决策系统。

随着机器学习模型在高风险领域(如社会服务、关键基础设施)广泛应用,设计者和审计人员需确保模型满足多样要求(如法规合规、公平性、计算约束),而不仅限于性能。现有方法面临严重挑战:后处理常损害性能,往往需微调或从头训练,代价高昂甚至不可行。本文提出统一框架,以数据驱动方式学习编辑神经网络,编辑器本身为图结构元网络,编辑仅需一次前向传播。元网络在神经网络群体上训练,优化目标包含两部分:强制满足特定要求,同时保持原模型效用。实验涵盖数据最小化、偏差缓解和权重剪枝等任务,相比主流后处理或重训练方法,在性能、合规性与效率间的权衡上均有提升。

原文摘要 · Abstract (English)

As machine learning models are increasingly deployed in high-stakes settings, e.g. as decision support systems in various societal sectors or in critical infrastructure, designers and auditors are facing the need to ensure that models satisfy a wider variety of requirements (e.g. compliance with regulations, fairness, computational constraints) beyond performance. Although most of them are the subject of ongoing studies, typical approaches face critical challenges: post-processing methods tend to compromise performance, which is often counteracted by fine-tuning or, worse, training from scratch, an often time-consuming or even unavailable strategy. This raises the following question: "Can we efficiently edit models to satisfy requirements, without sacrificing their utility?" In this work, we approach this with a unifying framework, in a data-driven manner, i.e. we learn to edit neural networks (NNs), where the editor is an NN itself - a graph metanetwork - and editing amounts to a single inference step. In particular, the metanetwork is trained on NN populations to minimise an objective consisting of two terms: the requirement to be enforced and the preservation of the NN's utility. We experiment with diverse tasks (the data minimisation principle, bias mitigation and weight pruning) improving the trade-offs between performance, requirement satisfaction and time efficiency compared to popular post-processing or re-training alternatives.

模型编辑合规性元网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。