arXiv:2602.00885cs.LG2026-02被引 2

让大模型选数据更可靠,应对存储中断和通信故障。

Reliability-Aware Determinantal Point Processes for Robust Informative Data Selection in Large Language Models

  • 用概率可靠性修正DPP,兼顾数据多样性和访问稳定性。
  • 在数据可能丢失的条件下仍能选出高质量训练子集。
  • 适合资源受限场景下大模型快速部署与高效训练。

信息性数据选择对大型语言模型(LLMs)至关重要,可减少微调、网络蒸馏和标记剪枝所需的训练数据量,实现快速高效部署,尤其在计算与通信受限条件下。传统子集选择方法(如基于确定性点过程,DPP)虽追求多样性,但假设所选数据批次始终可用且无错误,这一假设在部分存储中断、通信不完善及随机访问失败等场景下失效。我们发现原始公式在此类条件下会崩溃。为此,提出ProbDPP,一种新型可靠性感知的k-DPP实现,通过引入正则项重构目标函数,在数据访问具有不确定性时仍保持良好定义,并分解为几何多样性项与不可靠性成本。该目标支持在不确定环境下稳健地选择多样化数据批次。进一步将此问题建模为组合半老虎机问题,设计基于UCB的在线学习算法以高效估计未知可靠性。理论分析提供了该方法的后悔界,确保性能保障。

原文摘要 · Abstract (English)

Informative data selection is a key requirement for large language models (LLMs) to minimize the amount of data required for fine-tuning, network distillation, and token pruning, enabling fast and efficient deployment, especially under computational and communication constraints. Traditional subset selection methods, including those based on Determinantal Point Processes (DPP), focus on maximizing diversity but assume that selected data batches are always available error-free. This presumption prohibits their use under partial storage outage, imperfect communication, and stochastic access failures. Furthermore, we show that the original formulation collapses under such conditions. To address this gap, we introduce ProbDPP, a novel reliability-aware implementation of k-DPP that accounts for probabilistic data access by recasting the objective function with a regularization term that remains well-posed and decomposes into a geometric diversity term and unreliability cost. The resulting objective facilitates robust selection of diverse data batches under uncertainty. Furthermore, we frame this reliability-aware diversity maximization as a combinatorial semi-bandit problem and propose a UCB-style algorithm to efficiently learn the unknown reliability online. Theoretical analysis provides regret bounds for the proposed approach, ensuring performance guarantees.

大模型训练数据选择可靠性优化DPP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。