arXiv:2505.02209cs.IRcs.HC2025-05

用少量用户问题构建动态意图层级,提升对话推荐系统可扩展性。

Minimally Supervised Hierarchical Domain Intent Learning for CRS

  • 基于注意力机制的层次聚类,仅需少量数据优化意图分组。
  • 在4.4万条餐饮领域问题上,分层采样使所需问题数大幅减少。
  • 无需频繁重训练,适合持续演化的领域推荐系统使用。

在不断演进的领域结构中建模领域意图,是领域专用对话推荐系统(CRS)的重大挑战。传统方法依赖话语-意图对训练意图模型,但新意图不断出现时,需持续更新模型并保留原有关系,导致话语-意图对数量急剧增长,人工标注成本过高。本文提出一种高效动态层级结构构建方法,显著减少所需用户话语数量以实现充分领域知识覆盖。我们设计了一种基于神经网络的注意力驱动层次聚类算法,融合DEC与NAM两种现有平铺聚类方法的注意力机制。实验基于业务餐饮领域44,000条问题的精选子集,结果表明,采用分层采样策略能显著降低代表演化意图结构所需的问题数量。该方法可在不频繁重训练的前提下实现动态领域知识的有效覆盖,从而提升领域专用对话推荐系统的可扩展性与适应性。

原文摘要 · Abstract (English)

Modeling domain intent within an evolving domain structure presents a significant challenge for domain-specific conversational recommendation systems (CRS). The conventional approach involves training an intent model using utterance-intent pairs. However, as new intents and patterns emerge, the model must be continuously updated while preserving existing relationships and maintaining efficient retrieval. This process leads to substantial growth in utterance-intent pairs, making manual labeling increasingly costly and impractical. In this paper, we propose an efficient solution for constructing a dynamic hierarchical structure that minimizes the number of user utterances required to achieve adequate domain knowledge coverage. To this end, we introduce a neural network-based attention-driven hierarchical clustering algorithm designed to optimize intent grouping using minimal data. The proposed method builds upon and integrates concepts from two existing flat clustering algorithms DEC and NAM, both of which utilize neural attention mechanisms. We apply our approach to a curated subset of 44,000 questions from the business food domain. Experimental results demonstrate that constructing the hierarchy using a stratified sampling strategy significantly reduces the number of questions needed to represent the evolving intent structure. Our findings indicate that this approach enables efficient coverage of dynamic domain knowledge without frequent retraining, thereby enhancing scalability and adaptability in domain-specific CSRs.

对话推荐意图识别层次聚类少样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。