用神经符号方法修复工业旧模型,不重训也能提效降险
NSR-Boost: A Neuro-Symbolic Residual Boosting Framework for Industrial Legacy Models
- 通过残差定位预测失败区域,用大模型生成可解释专家
- 在6个公开数据集和1个私有数据集上超越现有最优方法
- 已在金融风控系统落地,显著降低坏账率,适合高并发场景
尽管梯度提升决策树(GBDT)主导工业表格数据应用,但在高并发生产环境中升级旧模型仍面临高昂重训成本与系统风险。为此,我们提出NSR-Boost——一种专为工业场景设计的神经符号残差增强框架。其核心优势在于“非侵入性”:将旧模型视为冻结模型,在预测失败的“难区域”进行针对性修复。框架包含三个阶段:首先通过残差识别难区域;其次利用大语言模型生成可解释的符号代码结构,并通过贝叶斯优化微调参数;最后通过轻量级聚合器动态融合专家与旧模型输出。实验表明,该框架在六个公开数据集和一个私有数据集上显著优于当前最优基线。更重要的是,已成功部署于某金融控股公司核心风控系统,真实线上流量实测显示性能大幅提升,坏账率显著下降。结果证明,该方法能有效捕捉传统模型遗漏的长尾风险,为工业界提供安全、低成本的模型演进范式。
原文摘要 · Abstract (English)
Although the Gradient Boosted Decision Trees (GBDTs) dominate industrial tabular applications, upgrading legacy models in high-concurrency production environments still faces prohibitive retraining costs and systemic risks. To address this problem, we present NSR-Boost, a neuro-symbolic residual boosting framework designed specifically for industrial scenarios. Its core advantage lies in being ``non-intrusive''. It treats the legacy model as a frozen model and performs targeted repairs on "hard regions" where predictions fail. The framework comprises three key stages: First, finding hard regions through residuals, then generating interpretable experts by generating symbolic code structures using Large Language Model (LLM) and fine-tuning parameters using Bayesian optimization, and finally dynamically integrating experts with legacy model output through a lightweight aggregator. Experimental results demonstrate that the framework significantly outperforms state-of-the-art (SOTA) baselines across six public datasets and one private dataset. More importantly, we report the successful deployment of NSR-Boost within the core financial risk control system of Qfin Holdings, where empirical results on real-world online traffic exhibit superior performance improvements and a significant reduction in the bad rate. In conclusion, it effectively captures long-tail risks missed by traditional models and offers a safe, low-cost evolutionary paradigm for industry.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。