arXiv:2602.11690cs.LGcs.AI2026-02

让机器学习自动识别数据贡献质量,提升模型性能与可解释性。

ANML: Attribution-Native Machine Learning with Guaranteed Robustness

  • 根据梯度一致性、验证状态等四要素动态加权训练数据。
  • 在5个数据集上误差降低33%-72%,20%高质量数据胜过100%均匀数据。
  • 支持贡献溯源,对抗恶意攻击时表现更稳健,适合高可靠性场景。

前沿人工智能系统越来越多地使用专业专家数据进行训练,如临床记录、专有研究和精心筛选的数据集,但现有训练流程对所有样本一视同仁。诺贝尔奖得主的贡献与未经验证的提交获得相同权重。我们提出ANML(Attribution-Native Machine Learning)框架,依据四个质量因素为训练样本赋权:基于梯度的一致性(q)、验证状态(v)、贡献者声誉(r)和时间相关性(T)。通过融合模型观测到的梯度信号与系统对数据来源的外部信息,ANML生成每贡献者的质量权重,同时提升模型性能并支持下游溯源。在5个数据集(178-32,561个样本)上,相较于仅依赖梯度的基线,ANML实现33%-72%的误差降低。质量加权训练具有数据高效性:仅20%高质量数据的表现优于100%均匀加权数据的47%。两阶段自适应门控机制确保ANML不会劣于任何可用基线,包括在伪造资质与梯度对齐相结合的联合攻击下。当样本级检测对细微污染失效时,贡献者级溯源带来的性能提升比样本级方法高出1.3-5.3倍,且随着污染难度增加,优势愈发明显。

原文摘要 · Abstract (English)

Frontier AI systems increasingly train on specialized expert data, from clinical records to proprietary research to curated datasets, yet current training pipelines treat all samples identically. A Nobel laureate's contribution receives the same weight as an unverified submission. We introduce ANML (Attribution-Native Machine Learning), a framework that weights training samples by four quality factors: gradient-based consistency (q), verification status (v), contributor reputation (r), and temporal relevance (T). By combining what the model observes (gradient signals) with what the system knows about data provenance (external signals), ANML produces per-contributor quality weights that simultaneously improve model performance and enable downstream attribution. Across 5 datasets (178-32,561 samples), ANML achieves 33-72% error reduction over gradient-only baselines. Quality-weighted training is data-efficient: 20% high-quality data outperforms 100% uniformly weighted data by 47%. A Two-Stage Adaptive gating mechanism guarantees that ANML never underperforms the best available baseline, including under strategic joint attacks combining credential faking with gradient alignment. When per-sample detection fails against subtle corruption, contributor-level attribution provides 1.3-5.3x greater improvement than sample-level methods, with the advantage growing as corruption becomes harder to detect.

机器学习可信AI数据溯源鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。