纠正客户流失预警中因季节性导致的误报,提升预警准确率
Seasonal false alarms in customer churn and decline early-warning systems: adjacent-window labels confound seasonality with decline, and a year-over-year correction
- 用同比同期窗口替代相邻周期窗口,从源头消除季节性干扰
- 生产数据中误报率下降30%~50%,预警准确率ROC-AUC从0.767升至0.864
- 适合需高精度客户干预的B2B平台,尤其关注季节性业务场景
客户流失预警系统用于生成客户经理的干预清单,每个标记账户都会消耗资源。在某企业级交易平台部署系统中,每三个被标记账户就有约一个在按季节对齐的标签下消失。传统非合同类流失预测以实体未来k个月活动与前k个月对比,但两窗口覆盖不同日历月,对季节性实体而言,阈值比率会混淆季节波动与真实衰退,事件发生率依赖标签锚点月份。本文形式化该机制,并在三个公开面板及生产面板上验证。相邻窗口衰减事件中,37%–69%(公开)和28%–50%(生产)在季节对齐定义下无对应。合并锚点虽平衡训练分布,却无法修正单个标签。现有替代方案仅部分修复曲线或改变检测时间窗。将基准窗口对齐至一年前相同日历月(从业者已有建议,本文首次形式化、测量并评估成本),可从源头平滑曲线。固定分类器后,生产留出集的衰退预测ROC-AUC从0.767升至0.864(目标不同;合成真实数据与生产回溯评估下差距缩小)。实际干预清单规模减少三分之一,从119降至79个账户。代价为需要更长历史数据,对先降后稳的案例存在盲区,且持续增长下判定更严格。
原文摘要 · Abstract (English)
Customer decline early-warning systems feed account-manager action lists, and every flagged account consumes intervention capacity. In a deployed business-to-business marketplace system, one action-list slot in three went to flags that dissolve under a seasonally aligned label. The standard target in non-contractual churn prediction compares an entity's next k months of activity with its trailing k months. The two windows cover different calendar months, so for seasonal entities the threshold-ratio construction confounds seasonality with decline, and the event rate depends on the label's anchor calendar month. We formalize the mechanism and measure it on three public panels and the production panel (the public arms pre-specified). Of the adjacent-window decay events, 37--69% on the public panels and 28--50% in production have no counterpart under a seasonally aligned definition. Pooling anchors, the standard remedy, balances the training mixture but corrects no individual label. Measured alternatives repair the curve only partially or change the detection horizon. Aligning the baseline to the same k calendar months one year prior -- advice practitioners already state, here formalized, measured, and costed -- flattens the curve at the source. With the classifier held fixed, production holdout ROC-AUC rises from 0.767 to 0.864 for decline (different targets; the gap closes on synthetic ground truth and a production hindsight referee). The served action list shrinks by a third, 119 to 79 accounts. The measured price is extra history, a blind spot to decline-then-stabilization, and a stricter cut under sustained growth.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。