arXiv:2510.10082cs.CLcs.LG2025-10被引 1

通过轨迹混洗与内容扰动增强用户偏好数据,提升个性化摘要生成效果。

Diversity Augmentation of Dynamic User Preference Data for Boosting Personalized Text Summarizers

  • 基于跨轨迹混洗和摘要内容扰动,构建多样化用户偏好数据
  • 使SOTA模型在AUC上提升0.132,个人化性能平均提升61.2%
  • 提出三种多样性度量指标,证明数据多样性是性能提升关键

文档摘要虽能高效提取用户相关内容,但受个体主观性影响,识别多维度文档中的主观重要信息极具挑战。这凸显了个性化摘要的必要性。然而,训练个性化摘要模型至今困难,主要因同时包含用户偏好历史(如点击-跳过轨迹)和目标摘要的多样化数据稀缺。现有MS/CAS PENS数据集虽有价值,但仅提供偏好历史而无目标摘要,无法支持端到端监督学习,且其话题转换多样性有限,制约泛化能力。为此,本文提出PerAugy,一种基于跨轨迹混洗与摘要内容扰动的数据增强方法,显著提升四种主流用户编码器的准确性(最佳结果:AUC↑0.132)。选取两种SOTA摘要框架为基线,发现引入改进后的用户编码器后,个人化性能平均提升61.2%(以PSE-SU4指标衡量)。进一步分析表明,所提三种数据集多样性度量(TP、RTC、DegreeD)中,TP与DegreeD与用户编码器性能高度相关,说明增强数据多样性是性能提升的核心因素。

原文摘要 · Abstract (English)

Document summarization enables efficient extraction of user-relevant content but is inherently shaped by individual subjectivity, making it challenging to identify subjective salient information in multifaceted documents. This complexity underscores the necessity for personalized summarization. However, training models for personalized summarization has so far been challenging, particularly because diverse training data containing both user preference history (i.e., click-skip trajectory) and expected (gold-reference) summaries are scarce. The MS/CAS PENS dataset is a valuable resource but includes only preference history without target summaries, preventing end-to-end supervised learning, and its limited topic-transition diversity further restricts generalization. To address this, we propose $\mathrm{PerAugy}$, a novel cross-trajectory shuffling and summary-content perturbation based data augmentation technique that significantly boosts the accuracy of four state-of-the-art baseline (SOTA) user-encoders commonly used in personalized summarization frameworks (best result: $\text{0.132}$$\uparrow$ w.r.t AUC). We select two such SOTA summarizer frameworks as baselines and observe that when augmented with their corresponding improved user-encoders, they consistently show an increase in personalization (avg. boost: $\text{61.2\%}\uparrow$ w.r.t. PSE-SU4 metric). As a post-hoc analysis of the role of induced diversity in the augmented dataset by \peraugy, we introduce three dataset diversity metrics -- $\mathrm{TP}$, $\mathrm{RTC}$, and \degreed\ to quantify the induced diversity. We find that $\mathrm{TP}$ and $\mathrm{DegreeD}$ strongly correlate with user-encoder performance on the PerAugy-generated dataset across all accuracy metrics, indicating that increased dataset diversity is a key factor driving performance gains.

个性化摘要数据增强用户建模多样性评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。