arXiv:2605.15299cs.IRcs.AI2026-05

通过剔除波动特征,提升搜索推荐模型的稳定性与准确性。

Fortress: A Case Study in Stabilizing Search Recommendations via Temporal Data Augmentation and Feature Pruning

论文配图:Fortress: A Case Study in Stabilizing Search Recommendations via Temporal Data Augmentation and Feature Pruning
图 1 · 摘自论文原文
  • 基于历史数据分段识别不稳定的预测样本,定位导致波动的特征。
  • 在真实应用中使预测方差降低37%,PR-AUC提升2.1个百分点。
  • 适合需要稳定输出的多阶段推荐系统,尤其关注信号波动问题的场景。

在搜索与推荐系统中,预测模型常因某些输入特征引发输出分数的时序波动,导致模型可靠性下降,尤其在多阶段系统中影响下游决策。本文提出Fortress,一种通用框架,通过识别并剔除引发预测不一致的特征来增强模型稳定性和准确性。该方法利用时间分段的历史快照数据,捕捉同一实体在不同周期的分数变化,执行四步流程:(1)收集历史快照,(2)识别预测不稳定的样本,(3)隔离并移除引发波动的特征,(4)仅用稳定特征重新训练模型。尽管基于LLM和BERT的语义特征具备良好泛化能力,但覆盖不全;而基于用户行为的特征虽预测力强,却易引入时序波动。Fortress通过抑制行为信号的波动性,同时保留其预测价值,在大型应用市场中的查询-应用相关性模型上验证有效。离线实验显示,预测稳定性(以变异系数衡量)显著提升,分类性能(以PR-AUC衡量)也取得2.1个百分点的增益。

原文摘要 · Abstract (English)

In search and recommendation systems, predictive models often suffer from temporal instability when certain input features introduce volatility in output scores. This instability can degrade model reliability and user experience especially in multi-stage systems where consistent predictions are critical for downstream decision making. We introduce Fortress, a general framework for enhancing model stability and accuracy by identifying and pruning features that contribute to inconsistent prediction scores over time. Fortress leverages historical snapshots temporally partitioned datasets capturing score fluctuations for the same entity across periods and follows a four-step process: (1) collect historical snapshots, (2) identify samples with unstable predictions, (3) isolate and remove instability-inducing features, and (4) retrain models using only stable features. While semantic features from LLMs and BERT-based models improve generalization, they often lack full query or entity coverage. Engagement-based features offer strong predictive power but tend to introduce temporal instability. Fortress mitigates this trade-off by suppressing the volatility of engagement signals while retaining their predictive value leading to more stable and accurate models. We validate Fortress on a query-to-app relevance model in a large-scale app marketplace. Offline experiments demonstrate notable improvements in prediction stability (measured by Coefficient of Variation) and classification performance (measured by PR-AUC).

推荐系统稳定性特征筛选

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。