研究代码缺陷预测中数据质量问题对神经网络训练过程的影响
Training Dynamics of Neural Software Defect Predictors under Coupled Data-Quality Issues
- 在控制条件下测试不平衡与重叠数据的联合影响
- 发现训练动态受耦合问题显著干扰,误差轨迹异常波动
- 适合关注模型可靠性与数据质量评估的研究者
软件缺陷预测支持测试优先级设定、发布风险评估和质量监控等维护决策。然而,基于度量的缺陷预测数据集常存在耦合的数据质量问题,尤其是类别不平衡和类别重叠。以往研究主要通过最终性能衡量其影响,但近期证据表明这些问题也可能体现在神经网络的训练动态中(如梯度、权重、偏置、误差轨迹)。现有研究多孤立分析单一问题,尚未揭示当两类问题耦合时,深度学习模型内部训练模式如何表现。本研究在类级别统一缺陷分布(UBD)数据集上,对固定MLP进行受控干预实验,在仅不平衡、仅重叠及二者联合三种条件下,共运行五次随机种子。每轮训练均记录各周期的动态数据,通过耦合比监控训练一致性。利用效应量、轨迹分析、敏感性检验及规则分类方法,系统刻画训练动态模式。预期贡献包括:提出一种交互感知的实证协议,以及面向度量型缺陷预测中耦合数据质量问题的训练动态模式候选分类体系。
原文摘要 · Abstract (English)
Context: Software defect prediction supports maintenance decisions such as testing prioritization, release-risk assessment, and quality monitoring. However, metric-based SDP datasets often contain coupled data-quality issues, especially class imbalance and class overlap. Prior work has mainly measured their impact through endpoint performance, while recent evidence suggests that such issues may also appear in neural training dynamics (gradients, weights, biases, error trajectories). However, these studies examine issues in isolation, leaving open how internal neural network training patterns manifest when data quality issues are coupled. Objective: We investigate how training-dynamics patterns from class imbalance, overlap, and their coupling can be characterized under interaction-aware conditions in deep learning-based SDP. Method: We conduct a controlled intervention study on class-level UBD datasets, training a fixed MLP under imbalance-only, overlap-only, and joint conditions across five seeds. Training dynamics are logged per epoch; fidelity is monitored via coupling ratios. Patterns are characterized using effect sizes, trajectories, sensitivity analyses, and rule-based classification. Expected contribution: The study will produce an interaction-aware empirical protocol and a candidate taxonomy of training-dynamics patterns for coupled data-quality issues in metric-based SDP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。